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In  this  dissertation  we  develop  a theory  for  some  distance 
constrained  tree  and  planar  network  location  problems.  Existing 
facilities  are  assumed  to  be  located  at  vertices  of  the  network.  The 
objective  functions  involve  distances  between  existing  and  new  facilities 
and  pairs  of  new  facilities.  The  distance  constraints  are  in  the  form  of 
upper  bounds  on  the  distances  between  selected  pairs  of  facilities.  The 
constraints  involving  pairs  of  new  facilities  complicate  the  problem 
considerably.  Although  related  problems  have  received  much  interest  in 
the  literature,  we  know  of  no  existing  solution  procedures  to  solve  the 
problems  we  consider,  which  are  continuous  in  nature. 

We  study  a 2-facility  problem  that  can  be  reduced  to  a problem  on 
a path  of  the  original  tree  network.  We  establish  a condition  under 
which  the  continuous  version  of  this  problem  can  be  converted  to  a single 
facility  problem  on  a line  segment.  For  the  discrete  version  of  the 
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2-facility  problem,  we  develop  dominance  rules  and  a procedure  that 
enumerates  a subset  of  solutions  to  find  the  optimal  locations. 

We  consider  a minimax  problem  with  n new  facilities,  and  develop 
several  solution  techniques  by  using  existing  theory  developed  for  the 
distance  constraints  problem.  We  compare  the  solution  procedures  in  a 
computational  test  and  report  our  results. 

We  pose  a general  problem  of  minimizing  some  nondecreasing 
function  of  distances  between  selected  pairs  of  facilities  subject  to 
constraints  on  some  of  the  distances  on  tree  networks.  We  show  how  the 
problem  can  be  converted  to  a linear  programming  problem.  The  linear 
problem  we  construct  is  not  a relaxation  of  the  original  problem  but  is 
equivalent  to  the  original  problem.  We  develop  a procedure  that  solves 
the  dual  of  the  linear  program  using  column  generation.  We  discuss 
several  column  generation  techniques,  and  experiment  with  these 
techniques  using  randomly  generated  problems. 

We  also  consider  the  general  problem  on  cyclic  planar  networks  and 
establish  upper  and  lower  bounds  on  the  optimal  objective  function  value 
of  the  problem.  Many  location  problems  on  cyclic  networks  are  known  to 
be  provably  hard.  We  use  techniques  we  develop  for  the  tree  networks  to 
arrive  at  bounds  for  the  problem  on  cyclic  networks.  We  develop  a 
sufficient  condition  under  which  the  solution  of  problem  on  the  cyclic 
network  can  be  found  by  solving  a restriction  of  the  problem  on  some 
spanning  tree.  We  evaluate  some  bounds  numerically  on  a set  of  problems 
and  report  our  computational  experience. 
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CHAPTER  1 
INTRODUCTION 


1,1  Motivation  of  the  Problems 

Many  organizations,  large  and  small,  public  and  private,  face 
locational  decisions  such  as  where  to  locate  fire  stations,  health 
clinics,  radar  stations,  parking  lots,  computer  centers,  police 
stations,  warehouses,  distribution  centers,  schools  and  post  offices. 

The  spatial  location  of  facilities  often  takes  place  in  the  context  of  a 
given  transportation  or  communication  system  which  may  be  represented 
for  analytical  purposes  as  a network  of  vertices  (for  example, 
population  centers  or  terminals)  and  arcs  (for  example,  roads  or 
transmission  cables)  connecting  pairs  of  vertices.  In  selecting  a set 
of  new  facility  locations  we  must  define  one  or  more  performance 
measures  for  the  system  level  of  service.  We  assume  each  measure  is 
some  function  of  transportation  or  communication  costs,  such  as  average 
travel  distance  or  maximum  response  time. 

1.1.1  The  Objective  Functions 

The  minisum  objective  (minimizing  the  weighted  sum  of  the 
distances  between  the  facilities)  may  well  be  appropriate  when  we 
consider  new  facilities  that  will  be  used  regularly  by  the  existing 
facilities  or  vice  versa.  In  this  case  weights  correspond  to  the 
frequency  of  usage,  and  our  purpose  is  to  minimize  the  total  distance 
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travelled  for  providing  (or  receiving)  the  service.  We  are  concerned 
with  the  total  cost  to  the  system,  rather  than  individual  costs.  This 
measure  is  perhaps  appropriate  when  locating  such  new  facilities  as 
banks,  schools,  computer  centers  and  warehouses.  The  minimax  objective 
(minimizing  the  maximum  weighted  distance  between  facilities)  may  be  most 
appropriate  when  we  consider  new  facilities  that  are  only  occasionally 
"used",  but  are  of  critical  importance  when  used.  This  objective  seems 
especially  important  when  locating  emergency  service  facilities.  The 
purpose  is  to  keep  the  maximum  possible  "loss"  that  is  incurred  due  to 
travel  distance  (or  time)  to  a minimum.  In  this  case  we  are  concerned 
with  individual  losses  and  the  system  performance  is  measured  by 
considering  only  the  worst  case  loss.  Many  network  location  problems 
studied  in  the  literature  use  either  the  minisum  or  the  minimax 
objective. 

The  choice  of  the  objective  function  depends  on  the  definition  of 
the  cost;  in  some  cases  a combination  of  the  minisum  and  rainimax 
objectives  is  more  appropriate.  For  example,  suppose  we  are  locating 
dispatch  centers  for  a private  ambulance  company.  According  to  our 
classification  above,  we  should  have  a minimax  objective  in  this  case. 
Although  this  is  an  emergency  service  for  the  users,  for  the  company  it 
is  a service  that  is  rendered  many  times  each  day.  Thus  the  company 
might  prefer  the  minisum  objective  in  order  to  minimize  the  total 
distance  their  vehicles  travel  (so  as  to  minimize  the  operating  cost). 

In  this  case,  a convex  combination  of  the  minisum  and  the  minimax 
objectives  (such  as  the  cent-dian  problem  in  Halpern  (1976,1978,1980)  and 
the  medi-center  problem  in  Handler  (1985)),  or  a minisum  objective  with 
an  upper  bound  (imposed  by  the  city  for  the  benefit  of  the  users)  on  the 


on  the  minimax  function  (such  as  in  Handler  and  Mirchandani  (1979))  may 
be  more  appropriate. 

Throughout  the  dissertation  we  assume  that  the  new  facilities  are 
distinguishable;  they  offer  different  kinds  of  services  to  the  existing 
facilities.  In  the  well-known  p-median  and  p-center  problems  the  new 
facilities  are  indistinguishable;  they  are  all  of  the  same  kind  and 
offer  the  same  service;  each  existing  facility  is  assumed  only  to  be 
served  by  the  "closest"  new  facility. 

1.1.2  The  Constraints 

In  the  problems  we  consider,  there  are  upper  bounds  on  the 
distances  between  selected  pairs  of  facilities,  which  we  term  "distance 
constraints".  We  study  two  kinds  of  distance  constraints,  between  pairs 
of  new  facilities,  and  between  existing  and  new  facilities.  The  purpose 
of  having  distance  constraints  between  pairs  of  new  facilities  is  to 
prevent  some  pairs  of  new  facilities  (such  as  the  police  station  and  the 
bank,  or  the  elementary  school  and  the  playgrounds)  from  being  too  far 
apart.  A distance  constraint  between  an  existing  facility  and  a new 
facility  may  represent  the  maximum  possible  travel  distance  to  render 
some  service.  In  the  case  of  an  ambulance  location  problem,  this 
constraint  may  represent  the  amount  of  time  within  which  a heart  attack 
patient  must  be  treated  in  order  to  survive.  In  this  respect  these 
problems  are  related  to  covering  problems  (Kolen  and  Tamir  (ip-  press)'1  • 
However,  unlike  some  covering  problems,  our  formulation  does  not  require 
the  upper  bounds  for  all  of  the  existing  facilities  with  respect  to  some 
new  facility  to  be  the  same. 
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The  distance  constraints  we  use  are  defined  by  Francis,  Lowe  and 
Ratliff  (1978).  These  researchers  develop  necessary  and  sufficient 
conditions  for  the  feasibility  of  the  distance  constraints.  They  also 
state  a procedure  that  either  discovers  the  constraints  are  infeasible  or 
locates  the  new  facilities  on  the  tree.  We  use  the  necessary  and 
sufficient  conditions  and  this  procedure  in  Chapters  3 and  4 extensively. 

Several  researchers  studied  some  network  location  problems  with 
upper  bounds  on  the  distances  between  existing  and  new  facilities,  such 
as  Francis  and  Lowe  (1981)  and  Tansel  et  al.  (1982).  However  to  the 
best  of  our  knowledge  there  is  no  literature  on  network  location  problems 
with  distance  constraints  relating  pairs  of  new  facilities.  These 
constraints  make  the  decision  variables  dependent  upon  one  another  and 
complicate  the  analysis  of  the  problem. 

We  note  that  in  a sense  the  weights  in  the  objective  function  and 
the  distance  constraints  play  similar  roles.  A higher  weight  (relative 
to  other  weights)  between  two  new  facilities  may  cause  these  new 
facilities  to  be  located  "closer"  to  one  another  than  a lower  weight. 
Likewise,  tighter  distance  constraints  may  have  the  same  effect. 

1.2  Tree  Networks 

With  the  exception  of  Chapter  5,  in  all  of  the  problems  we 
consider  the  underlying  network  structure  is  a tree.  The  tree  location 
problems  are  analytically  tractable  due  to  the  convexity  of  distance 
functions  on  the  tree,  a property  that  is  lost  in  general  networks. 
Dearing,  Francis  and  Lowe  (1976)  develop  and  discuss  convexity  properties 
of  trees.  The  solution  procedures  on  general  networks, usually  employ- 
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mathematical  programming  techniques  and  may  not  exploit  the  fact  that  the 
underlying  structure  is  a network. 

In  a general  network,  we  can  hope  to  get  a good  initial  solution 
and  bounds  to  be  used  in  an  exact  solution  procedure  (usually  some 
implicit  enumeration  scheme)  for  the  problem.  We  consider  some  such 
problems  on  general  networks  and  discuss  how  bounds  on  the  optimal 
objective  function  value  of  the  general  problem  can  be  developed  using 
spanning  trees  and  the  separation  conditions. 

Some  real  networks  are  actual  trees.  Francis,  McGinnis  and  White 
(1983)  point  out  the  following.  A river  system  with  the  tributaries 
(which  is  used  in  many  countries  as  the  main  transportation  link)  is 
usually  a tree.  Some  state  highway  systems  within  the  U.S.  also  are 
trees.  Highway  are  expensive  to  build;  thus  some  states  tend  to  build  a 
highway  system  with  minimal  connections,  avoiding  costly  alternate  routes 
between  pairs  of  cities,  which  in  turn  results  in  a tree.  "Spoke  and 
hub"  networks,  trees  with  star-like  structure,  often  occur  in 
distribution  systems.  Some  commercial  airlines  use  some  central  airport 
as  a hub,  avoiding  costly  connections  between  small  cities.  This  may 
also  result  in  a flight  network  much  like  a tree.  Some  new  manufacturing 
facilities  are  designed  to  resemble  trees,  in  order  to  cut  down  the 
materials  handling  and  expansion  costs.  There  is  a "spine",  which 
handles  almost  all  of  the  materials  handling,  and  the  different 
departments  are  located  along  the  spine.  This  design  facilitates  adding 
or  deleting  departments  and  results  in  a tree  network. 

In  addition  to  these  examples  of  real  trees,  some  general  networks 
can  be  closely  approximated  by  trees.  Most  railroad  networks  are 
"treelike"  and  can  be  approximated  quite  accurately  by  a tree.  As  an 


example,  we  show  the  railroad  network  of  CN  (Canadian  National)  in 
Western  Canada  in  Figure  1.1  (Page  7);  CN,  a crown  corporation,  is  the 
largest  railroad  company  in  Canada.  All  of  these  reasons  have  encouraged 
research  on  the  trees.  The  earliest  tree  location  paper  we  know  of  is  by 
Hua  et  al.  (1962) . 

The  seminal  papers  by  Hakimi  (1964,  1965)  sparked  great  interest 
in  network  location  models.  The  literature  on  tree  location  problems, 
and  in  general  on  network  location  problems,  has  grown  rapidly  in  the 
last  twenty  years.  The  text  Location  on  Networks  by  Handler  and 
Mirchandani  (1979)  and  the  survey  paper  "Location  on  Networks:  A Survey" 
by  Tansel , Francis  and  Lowe  (1981)  are  both  excellent  sources  of 
information  in  this  area.  There  are  also  papers  that  specialize  in  a 
certain  subgroup  of  location  problems  on  networks.  A sequence  of  papers 
by  Kariv  and  Hakimi  (1979a,  1979b)  concentrate  on  p-median  and  p— center 
problems  on  networks,  and  a monograph  by  Kolen  (1982)  studies  several 
location  problems  on  trees. 

1.3  Notation 

Throughout  the  dissertation  we  use  the  following  notation.  Let  T 
represent  a connected  and  acyclic  network,  a tree,  with  a set  of  vertex 
locations  V={v.  :l<_i<_m)  and  a set  of  undirected  arcs,  E.  We 
assume  the  existing  facilities  are  located  at  the  vertices  of  the  tree. 

We  use  the  expression  "existing  facility  i"  to  mean  the  existing  facility 
located  at  vertex  v_^.  Each  arc  has  a positive  length.  The  distance 
between  any  two  points  x and  y,  denoted  by  d(x,y),  is  defined  to  be  the 
length  of  the  unique  simple  path  joining  x and  y.  The  vector  D(X) 
consists  of  a set  of  distances  between  selected  pairs  of  facilities. 


7 


Figure  1.1:  CN's  (Canadian  National)  Western  Canada  railroad  network. 
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We  denote  the  location  vector  by  X,  with  x ^ (1  <_  j <_  n) 
corresponding  to  the  location  of  new  facility  j.  An  optimal  location 
vector  is  denoted  by  X . The  measure  of  "interaction"  (communication) 
between  the  existing  facility  located  at  vertex  v^  and  new  facility  j is 
denoted  by  w.  and  the  measure  of  interaction  between  new  facilities  j 
and  k is  denoted  by  v^.  We  often  refer  to  the  w^.  and  v ^ as  "weights". 
All  weights  are  nonnegative. 

The  upper  bound  on  the  distance  between  the  existing  facility  and 
the  new  facility  j is  s„;  we  denote  the  set  of  such  bounds  as  EN-type 
distance  constraints.  The  upper  bound  between  the  new  facility  pair 
(j,k)  is  denoted  by  r^,  and  we  denote  the  set  of  these  upper  bounds  by 
NN-type  distance  constraints.  We  use  the  terms  EN-type  and  NN-type  also 
for  the  objective  function,  to  express  in  a compact  way  which  distance 
functions  are  included  in  the  objective  function.  This  notation  is  used 
uniformly  in  all  chapters.  We  define  any  other  notation  before  using  it, 
in  the  respective  chapter  or  section. 

We  refer  to  a problem  with  no  distance  constraints  as  an 
"unconstrained  problem"  and  a problem  with  distance  constraints  as  a 
"constrained  problem".  In  several  occasions  we  relax  the  distance 
constraints  and  solve  the  unconstrained  problem  to  guide  us  in  the 
solution  of  the  constrained  problem.  We  also  make  a distinction  between 
a "restricted"  versus  an  "unrestricted"  problem.  We  use  the  expression 
"restricted  problem"  if  the  solution  space  is  restricted  to  the  set  of 
vertices  of  the  tree  and  "unrestricted  problem"  if  the  solution  space  is 


the  entire  tree. 


1.4  The  Problems  of  each  Chapter 


We  now  state  the  problems  we  consider  in  Chapters  2 through  5 
formally.  In  Chapter  2 we  study  the  following  problem, 
min  f(x^,x2) 
s.t.  d(x^  ^2)  r 12 > 

where  f is  a convex  function.  We  consider  as  special  cases  of  f the 
summation  and  maximization  functions.  We  study  both  the  restricted  and 
unrestricted  versions  of  these  problems,  suggesting  solution  procedures 
for  each  version.  The  procedures  use  the  solution  of  the  unconstrained 
problem  in  solving  the  constrained  problem.  We  reduce  the  unrestricted 
version  of  the  constrained  problem  to  a single  facility  problem  in  the 
case  the  distance  constraint  is  active.  The  restricted  version  of  the 
constrained  problem  is  solved  by  controlled  enumeration.  We  then  show 
that  the  objective  function  can  be  extended  to  include  the  NN-type  term, 
V12^^X1’X2^’  smaH  changes  in  the  suggested  solution  procedures. 

In  Chapter  3 we  study  the  multifacility  minimax  version  of  the 
problem  in  Chapter  2. 

min  { max  { w_d(Xj,v^)  : i = 1,  . ..,  m;  j = 1,  . . . , n } } 

s.t.  d(x^.,x^)  _<  r .j^,  1 <_  j < k n. 

To  solve  this  problem  we  utilize  the  necessary  and  sufficient 
conditions  (separation  conditions)  for  the  feasibility  of  the  distance 
constraints.  We  suggest  four  different  solution  procedures,  each  of 
which  generates  a sequence  of  objective  function  values  converging  to  an 
optimum.  We  also  report  on  a computational  experiment  comparing  the  four 
solution  procedures. 

The  unconstrained  versions  of  the  multifacility  minimax  and 
minisum  problems  have  received  much  attention  in  the  literature;  we 
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discuss  the  related  work  in  the  corresponding  chapters.  On  general 
networks  these  problems  are  shown  to  be  NP-hard  by  Kolen  (1982). 

In  Chapter  4,  we  use  a more  general  approach  than  in  the  previous 
chapters.  We  consider  the  following  problem, 
min  f 0(D(X) ) 

s.t.  fh(D(X))  < bh,  1 < h < p, 

where  the  constraint  functions  depend  upon  EN  and  NN-type  distances  and 
the  objective  function  may  include  both  EN  and  NN  type  terms.  We  show 
that  for  linear  f^  (0  h <_  p)  this  problem  can  be  converted  to  a linear 
programming  problem  using  a monotonicity  result  and  the  separation 
conditions.  We  suggest  a revised  simplex  scheme  with  column  generation. 
We  consider  several  column  pricing  techniques  and  report  on  the  relative 
effectiveness  of  these  alternative  pricing  techniques  based  on  a 
computational  experiment.  We  focus  on  the  multifacility  minisum  problem 
with  distance  constraints  in  the  experiment. 

In  Chapter  5,  we  use  the  techniques  suggested  in  Chapter  4 on 
general  networks.  By  solving  restriction  problems  on  selected  spanning 
trees  of  the  general  network  we  arrive  at  an  upper  bound  and  a feasible 
solution  for  the  general  problem.  We  also  compute  a lower  bound  on  the 
optimal  objective  function  value  of  the  general  problem.  We  report  the 
results  of  our  computational  experience  with  the  bounds. 

We  discuss  related  literature  further  in  the  individual  chapters. 


CHAPTER  2 

TWO-FACILITY  PROBLEMS 


In  this  chapter,  we  study  some  2-facility  problems.  We  find 
optimal  locations  of  the  two  new  facilities  with  respect  to  existing 
facilities  located  at  vertices  of  the  tree.  The  object  is  to  minimize 
some  measure  of  the  distances  between  the  new  facilities  and  the  existing 
facilities  subject  to  an  upper  bound  on  the  distance  between  the  two  new 
facilities.  The  problem  can  be  formulated  as  follows: 

(P2)  min  f (X) 

s.t.  d(x-^  ^2)  r 2 * 

X in  S, 

where  f(X)  = g(f  j(x^)  ,f  2^2^ ) > fq  and  ^2  are  convex  functions,  g is 
nondecreasing  in  each  component,  and  S = V or  S = T.  When  referring  to 
the  function  g in  this  chapter,  we  use  the  term  "nondecreasing",  dropping 
"in  each  component"  for  convenience.  The  functions  f^,  f2  and  g are 
continuous  and  real-valued. 

We  note  that  an  optimum  of  f(X)  and  fj(x^),  for  j = 1,  2,  exists 

on  S,  since  S is  nonempty  and  compact  (closed  and  bounded)  and  the 

functions  f,  f^  and  f2  are  continuous. 

As  in  Dearing,  Francis  and  Lowe  (1976)  we  define  the  set  of 

locations  L (X,Y)  = { Z in  T : d(x.,z.)  + d(z  ,y  ) = d(x.,y.), 
a J J J J J J 

d(Zj'Xj)  = ad(xj.Yj);  j = 1,  2 } for  0<  a < 1,  Let  Zg  be  the  unique 

element  of  the  set  L (X,Y),  for  a given  value  of  a.  A function  f(X)  is 

a. 

called  convex  if  for  each  distinct  pair  of  vectors  X and  Y and  for  every 
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a e (0,1)  we  have  f(Z  ) <_  af(X)  + (l-a)f(Y).  Although  we  assume  convex 
functions,  the  results  we  derive  are  valid  for  quasiconvex  functions. 
Recall  that  a function  f is  said  to  be  quasiconvex  if  for  each  distinct 


pair  of  vectors  X and  Y and  for  every  a e (0,1)  we  have 

f (Z  ) < max  { f (X) ,f (Y)  }.  If  f is  a real-valued  quasiconvex  function 
3 

with  a global  minimum  X,  f has  the  property  that  it  is  nondecreasing 
along  any  line  segment  ending  at  X in  the  sense  that  for  any  Y with  Z^  in 
L (X, Y)  we  have  f(X)  < f(Z  ) < f(Y)  for  every  a e (0,1).  This  is  the 
critical  property  used  in  most  of  our  proofs. 

We  first  derive  some  results  for  this  general  version  of  the 
problem  and  then  state  algorithms  for  the  following  two  special  cases  of 
g,  which — when  unconstrained — have  received  much  attention  in  the 
literature:  minisum  and  minimax.  For  these  two  cases  the  function 

defined  ^ y-L  + y2  a°d  raax  { ) respectively,  and  is 

clearly  a nondecreasing  function. 

In  the  minisum  problem,  the  objective  function  is  the  weighted  sum 
of  the  distances  between  new  and  existing  facilities.  This  problem  can 


be  formulated  as 


min  f(X)  = {{  E E w_d(x.,v^)}  : i = 1,  ...»  m;  j = 1,2} 
s.t.  d(x^  ,x^)  <_  r i2* 

This  problem  and  the  2-median  problem  differ  in  that  in  this  problem  each 

existing  facility  is  assumed  to  be  served  by  both  new  facilities  (if  all 

w.  . > 0).  In  the  2-median  problem  the  existing  facilities  are  served 
ij 

only  by  a "closest"  new  facility.  (Thus  the  2-median  solution  also 
partitions  the  vertices  into  two  sets.)  In  the  problem  we  study,  the  new 
facilities  are  of  different  kinds;  they  do  not  "compete"  for  customers, 
but  new  facility  j serves  each  existing  facility  i with  w > 0. 
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In  the  minimax  problem,  we  minimize  the  maximum  weighted  distance 
between  existing  facilities  and  new  facilities.  This  problem  can  be 
formulated  as  : 

min  f(X)  = { max  „ {w^d(x  ^ , v^) } : i = 1,  ...»  m;  j = 1,2} 
s.t.  d(x-^ ^2)  <_  ri2" 

This  problem  objective  differs  from  the  objective  of  the  2-center  problem 
in  the  same  way  the  minisum  objective  differs  from  the  2-median 
objective.  Depending  on  the  nature  of  the  services  provided  by  the  new 
facilities  the  minimax  objective  may  be  more  appropriate  than  the 
minisum. 

We  note  that  the  results  we  state  and  prove  next  also  go  through 

if  we  have  "additive  terms"  in  the  objective  functions  of  the  problems  we 

stated  above.  For  example,  we  can  state  for  the  minimax  case 

f .(x  .)  = max  { w.  .d(x.,v.)  +h..  : i = 1,  ...,  m}.  The  addend  h may 
J J ij  J i iJ  1J 

correspond  to  some  fixed  cost  associated  with  new  facility  j serving 
existing  facility  i. 


2.1  General  Results 


We  now  state  some  general  results  for  P2.  Denoting  the  optimal 
solutions  to  the  independent  single  facility  problems  by  x^  and  x^ 


(i.e.  f (x?)  = min  fj(x^))  and  the  optimal  solution  to  P2  by  (x^.x^)  we 
have  the  following  lemma: 

Lemma  2.1  (Path  Localization  Lemma):  There  exists  an  optimal 

* * 

solution  to  P2  with  optimal  locations  x^  and  both  on  the  path 
P(x°,x°). 


* * 
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Proof : Choose  any  XpX2  with  d(x^,x2)  iL  r\2‘  ^or  J = ^et  xj 

be  the  unique  closest  point  in  P(x^,x2)  to  x^..  Because  f ^ is  convex, 
it  is  nonincreasing  on  any  path  ending  at  a global  minimum,  hence 
f (x.)  > f.(x’)  > f.(x°)  for  j = 1,2,  implying 

g(f1(x1),f2(x2))  > g(f1(xp,f2(x'))  > g(f1(x°),f2(xp)  since  g is  a 
nondecreasing  function  of  f.  and  f2- 

If  P(x1,xJ)  and  P(x2,x2)  are  disjoint  then 
P(x1,x2)  = P(xpxp  P(xj,xp  P(x’,x2).  We  have 
d(x1>X2)  = d(x1>xp  + d(xj.x')  + d(x’,x2).  Thus  d(xjfxj)  < d(Xl,x2), 
since  d(XpXp  + d(x2>x2)  >_  0.  Since  by  our  assumption  d(x15  x2)  < r12, 
we  have  d(xj,xj)  <_  r12.  If  P(x1#xp  and  P(x2,xp  are  not  disjoint  then 
x|  = x2  and  hence  d(xpxp  = 0 <_  r12.  Thus  we  have  constructed  a 
feasible  solution  (xpxp,  with  xj  and  x2  on  P(x°,x2)  and  an  objective 
function  value  no  worse  than  f(x^,x2).[] 

This  lemma  is  a useful  result  that  enables  us  to  restrict 
ourselves  to  P(x^,x2)  when  solving  P2.  The  original  problem  on  the  tree 
is  thus  converted  to  a problem  on  a single  path.  This  main  result  will 
be  used  in  all  subsequent  analysis  in  Chapter  2. 

Since  the  problem  on  a single  path  is  equivalent  to  the  problem 
with  rectilinear  distances,  we  refer  to  some  related  research  for  the 
rectilinear  distance  version  of  similar  problems  with  n new  facilies, 
where  n J>  2.  Dearing  and  Langford  (1975)  considered  the  unconstrained 
version  of  the  problem  on  the  tree  with  an  EN  and  NN-type  minisum 
objective  function.  They  imbed  the  tree  into  the  Euclidean  space  R^3  for 
some  p.  They  then  decompose  the  problem  in  R*3  into  p subproblems  and  use 
known  solution  techniques  (such  as  in  Francis  and  White  (1974))  to  solve 
the  separate  rectilinear  distance  problems.  Francis  and  White  (1974) 
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discuss  the  multifacility  rectilinear  minimax  location  problem  with  EN 
and  NN-type  constraints.  They  suggest  a linear  programming  formulation 
based  on  the  results  of  Dearing  and  Francis  (1974a).  Dearing  and  Francis 
(1974a)  use  a network  flow  model  to  solve  the  problem  we  study,  with  both 
EN-type  constraints  and  NN-type  constraints  with  rectilinear  distances. 
Pritsker  and  Ghare  (1970)  study  the  unconstrained  problem  with  EN  and  NN- 
type  minisum  objective  function  for  the  case  of  rectilinear  distances. 
They  start  out  by  locating  each  new  facility  at  its  respective  optimal 
location,  disregarding  the  mutual  communication  factors  (the  NN-part  of 
the  objective  function).  Then  they  start  moving  the  new  facilities  by 
computing  directional  derivatives  and  using  a steepest  descent  approach. 

We  will  solve  two  different  versions  of  this  problem;  the  vertex 
restricted  version  (all  optimal  locations  on  the  vertices  of  the  tree) 
and  the  unrestricted  version  (optimal  locations  can  be  anywhere  on  the 
tree).  Next  we  develop  a result  that  we  will  use  when  solving  both 
versions  of  the  problem. 

Lemma  2.2  (Dominance  Lemma):  Consider  pairs  (UpU2)  and  (vpV2) 
with  Up  u2,  v1  and  on  P(xpX2).  If  the  path  between  and  u2  is 
contained  in  the  path  between  v^  and  v2,  then  f(upU2)  f(vpV2). 

Proof : We  shall  assume  d(vpX^)  <_  d(v2,x^),  for  if 

d(vi,x^)  > d(v2,x^)  then  f nondecreasing  on  any  path  ending  at  fj(x^) 
implies  f^v^  >.  f1(v2)  and  f2(v2)  2 f^v^,  in  turn  implying 
f(vpV2)  >_  f(v2,v1).  Due  to  a similar  reasoning  we  assume 
d(upX^)  _<  d(u2,Xj).  Combining  the  inequalities  dtvpX^)  _<  d(v2,x^)  and 
d(UpX^)  _<  d(u2,x^)  with  the  hypothesis  of  the  lemma  we  have  Vj  on 
P(u1,x1°)  and  on  P(u2,x2^). 
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Due  to  convexity,  f2  is  nonincreasing  along  any  path  ending  at  a 
global  minimum.  Thus  we  have  f^Cu^)  2 f2(v2)  — s"’’nce  x2  :''s  a 

global  minimum  of  f 2 • Similarly,  f^(u^)  2 f^(v^)  2 Since  g is 

nondecreasing,  we  have 

f(u1,u2)  = g(f1(u1),f2(u2))  2 g(f1(v1),f2(v2))  = f (vi , v2) . [ ] 

Given  (u^u^  and  (vpV2)  satisfying  the  hypothesis  of  Lemma  2.2, 
we  will  call  (u^,u2)  a dominated  pair.  A feasible  pair  that  is  not 
dominated  by  any  other  pair  is  called  a candidate  pair . As  a result  of 
this  lemma  we  can  exclude  all  dominated  pairs  from  the  search  for  an 
optimal  pair.  We  use  this  lemma  to  limit  the  search  for  an  optimal  pair 
to  the  set  of  candidate  pairs  (v^,v2),  where  u^  and  u2  are  vertices  of 
the  tree,  when  solving  the  vertex  restricted  version  of  the  problem. 

Next  we  will  state  a corollary  to  Lemma  2.2.  This  corollary 
serves  as  an  existence  result  for  the  optimal  locations  of  the 
unrestricted  problem. 

Corollary  2.1:  If  d(x^,x2)  > r^2,  then  for  a feasible  solution 
(x^,x2)  to  the  unrestricted  2-facility  problem,  there  exists  a solution 
(xj,x2)  with  d(xj,x2)  = r^2  and  f(x^,x2)  >_  f(xj,x2). 

Proof : Choose  any  (x^,x2)  on  P(x^,x2)  with  d(x^,x2)  < r^. 

(Note  we  only  need  to  consider  x^  and  x2  on  P(x^,x2)  due  to  Lemma  2.1.) 
Choose  x j on  P(x^,x^)  and  x2  on  P(x2>x2)  such  that  d(x|,xp  = r^. 

(We  know  that  such  a pair  (xj,x2)  exists  by  our  hypothesis.) 

Again,  f^x^)  2 f-]_(xp  2 and  f2^X2^  — f2^xP  — f2^X2^’ 

Thus  f(x1,x2)  2f(xJ,x2).[] 

Subsequently,  we  can  limit  our  search  for  the  optimal  solution  to 
the  unrestricted  2-facility  problem  to  locations  (x^,x2),  with 
d(x1,x2)  = r12. 


For  nontriviality  of  each  version  of  the  problem  we  need 
dCx^.x^)  > r12*  Otherwise  xj'  = x°  and  x2  = x°  and  the  distance 
constraint  is  redundant.  From  now  on  we  assume  that  d(x^,x2)  > r^. 

We  now  derive  an  important  result  by  combining  Lemma  2.1  and 
Corollary  2.1.  The  algorithm  for  the  unrestricted  version  of  the  problem 
is  based  on  this  result. 

Lemma  2.3:  Provided  that  the  distance  constraint  is  active,  the 
2-facility  problem  on  the  tree  can  be  converted  to  a single  facility 
location  problem  on  the  line. 

Proof:  The  objective  function  of  the  2-facility  problem  on  the 
tree  can  be  expressed  as  g(f ^(x^) ,f2(x2)) • By  Lemma  2.1  we  know  that 
this  problem  is  equivalent  to  a path  problem  and  thus  to  a problem  with 
absolute  value  distances.  We  can  embed  the  path  P(x^,x2)  in  the  real 
line  and  treat  it  as  a line  segment.  Denoting  the  embedding  of  x ^ by  y 
and  the  embedding  of  the  existing  facilities  by  a^,  we  have 
d(Xj,vi)  = | y j - a_J.  By  Corollary  2.1  we  have  |y^  - y2|  = r^. 

A solution  where  each  new  facility  is  closer  to  its  unconstrained  optimum 
than  the  other  facility  is  clearly  produces  a lower  objective  function 
value  than  the  other  way  around,  hence  we  can  substitute  y2  = y^  + r ^2 
(instead  of  y1  = y2  + r^).  Usin§  this  substitution  in  the  objective 
function  of  the  problem  we  get 

g(f1(y1).f2(y2))  = g(fi(yi)’f2(yl  + ri2^  ^ 

= G(y1). 

Thus  the  problem  is  equivalent  to  a single  facility  problem. [] 

As  a result  of  this  lemma,  we  can  use  well-known  single  facility 
algorithms  to  solve  the  constrained  2-facility  problems  on  the  tree.  In 


18 


Section  2.3  we  explain  the  transformation  to  the  single  facility  problem 
and  describe  G(y^)  for  each  of  the  two  special  versions  we  study. 

Next  we  state  a result  that  can  be  useful  in  solving  both  the 
restricted  and  the  unrestricted  versions  of  the  general  problem. 

We  note  that  if  d(v^,v.)  > r^  for  all  (v^»vj)  where  v^  = v ^ 
along  PCx^xp,  then  we  need  to  have  = x 2 for  feasibility  of  the 
vertex  restricted  problem.  Also,  for  the  unrestricted  version,  the 
special  case  of  r^  = 0 results  in  the  two  facilities  being  located  at 
the  same  point  (not  necessarily  a vertex).  In  order  to  exploit  the 
additional  structure  in  these  two  special  cases,  we  consider  a related 
problem,  the  collapsed  facility  problem 
(PO)  min  fCx^^) 
s.t.  x^  = X2« 

Note  that  the  constraint  x^  = X2  makes  all  constraints  of  the  form 
d(x1,x2)  <.  r12  redundant,  since  x^  = x2  corresponds  to  dCx^^)  = 0. 

For  PO  we  have 

min  f(x1,x2)  = min  gCf^x^  ,i^{x^)) 

= min  g(f1(x),f2(x)) 

= min  G(X). 

Provided  that  f^  and  f2  are  functions  of  weighted  distances,  we 

need  to  solve  a single  facility  problem  with  weights  w^  = g(w^  ,Wi2>  * 

where  g is  either  a max  or  a sum  operator.  Denoting  the  optimal  location 

of  the  collapsed  facility  by  x^,  the  optimal  solution  to  the  special  case 

* * 0 

of  the  2-facility  problem  stated  above  will  be  x^  = X2  = x . 

The  next  lemma  can  be  used  to  facilitate  the  solution  of  the 
special  versions  of  the  problem  we  discussed  above. 
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Lemma  2.4  (Collapsed  Facility  Lemma):  There  exists  an  optimal 
solution  to  PO  that  is  on  the  path  PCx^.x^). 

Proof : Choose  any  x not  on  P^^x^),  let  x'  be  the  unique  closest 
point  in  PCx^.x^)  to  x.  By  a reasoning  similar  to  the  one  used  in  the 

I f 

proof  of  Lemma  2.1  we  have  g(f^(x  ),f2(x  ))  <_  g(f ^(x) ,f2(x)) . [ ] 

We  now  proceed  to  the  algorithms.  First  we  give  a motivation,  and 
then  we  state  each  algorithm  formally.  We  then  indicate  the  special 
versions  of  the  general  algorithm,  namely  for  the  minisum  and  the  minimax 
objectives.  We  first  consider  the  algorithm  for  the  vertex  restricted 
problem. 


2.2  The  Vertex  Restricted  Problem 


Throughout  this  section,  x^  (j  = 1,2)  denotes  the  vertex 

restricted  minimizer  of  f .,  and  x^  denotes  the  collapsed  vertex  optimum. 

Suppose  the  global  minimum  of  f . is  on  some  arc  (v  ,v  ).  To  find  the 

J sc 

vertex  minimizer  of  f . we  only  need  to  consider  v and  v due  to  the 

J sc 

convexity  of  f . Thus,  x°  = vg  if  fj(vg)  < fj(vt)  and  xj  = vt  otherwise. 
Note  that  f ^ is  still  decreasing  along  a sequence  of  vertices  leading  to 


x°.  The  collapsed  vertex  optimum,  xu,  can  be  found  similarly.  We  denote 

^ V V 

the  vertex  restricted  minimizer  of  fCx^.x^)  by  (x^.x^. 


0 


We  first  state  the  general  algorithm  for  the  vertex  restricted 
problem,  and  then  focus  on  the  minisum  and  minimax  versions  in  Sections 
2.2.1  and  2.2.2  respectively. 
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VERTEX-2: 

Step  1:  Find  optimal  (vertex  restricted)  locations  for  the  two  single 
facility  problems. 

Step  2:  Find  all  candidate  pairs  of  vertices  (pairs  that  are  feasible  and 
not  dominated)  along  the  path  between  the  two  optimal  locations 
found  in  Step  1. 

Step  3:  Evaluate  the  objective  function  for  each  candidate  pair,  and 
choose  the  pair  with  the  smallest  objective  function  value. 


It  is  apparent  from  this  motivation  that  we  are  using  the  Path 
Localization  Lemma  in  Step  2 and  the  Dominance  Lemma  in  Step  3. 
Essentially  this  algorithm  is  a limited  enumeration  procedure.  We  now 
formally  state  the  algorithm.  (In  our  formal  algorithm  statements,  we 
follow  the  algorithm  language  suggested  and  used  by  Baase  (1978)  in  the 
text  Computer  Algorithms  as  closely  as  conveniently  possible.  We  will 
however  use  English  to  avoid  unnecessary  formality  or  to  describe  what  a 
particular  step  does.) 


Step  1:  Find  x^  and  x^  by  first  independently  minimizing  f^  and  f£  using 

an  appropriate  algorithm. 

,,  0 0W  V 0 V 0 

If  d^^)  <.  r^  then  x^  = x^;  X2  = x2« 

If  d(u.,u.)  > r.„  for  all  distinct  vertices  u.,u.  in  P(x^,x?) 

1 j 12  1 J 12 

..  . 0 , . „ V V 0 

then  find  x and  let  x^  = X2  = x 


endif 

Step  2:  Consider  only  vertices  along  the  path  between  the  two 

unconstrained  optima  found  in  Step  1.  Construct  a list  of 
candidate  pairs.  Renumber  the  vertices  along  the  path  as 


{ u^ , U2 , • • • » 


u } . (To  simplify  the  statement  we  use  a coloring 
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procedure  here.) 

i=l;j=l;k=l;  color  u.; 

while  u is  not  colored  do 
P 

extend  the  coloring  of  the  path  towards  u^,  until  either 
the  point  a distance  r^  from  u^  is  colored  or  u^  is  colored; 
if  no  vertex  is  newly  colored  then 
i = i+1 

else  j = index  of  the  most  recently  colored  vertex  on  the  path; 
candidate  pair  k = (u^,Uj); 
k = k+1; 
i = i+1; 
endif 

end 

Step  3:  Compute  the  objective  function  value  for  each  candidate  pair;  the 
pair  with  the  smallest  objective  function  value  gives  optimal 
locations. 

We  include  an  algebraic  statement  of  Step  2.  The  algebraic 
statement  may  be  useful  for  coding, 
i = 1;  j = 1;  k = 1; 
while  j < p do 

if  d(ui,Uj)  <_  r12  then  j = j+1 ; 

else  k1"*1  pair  is  (u^,u.  ^);  k = k+1;  i = i+1; 

while  d(u.,u.)  > r.„ 
i J 12 

end 

last  pair  is  (u^.u^)) 


do  i = i+1  end 
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Before  we  describe  the  two  special  cases  of  this  general  procedure 
we  discuss  the  order  of  the  common  step.  In  Step  2,  for  each  vertex  vg 
along  the  path  under  consideration  there  is  at  most  one  other  vertex  v 
such  that  the  pair  (v  ,vt)  is  feasible  and  not  dominated.  Thus  there  are 
0(m)  candidate  pairs.  In  the  procedure  described  above,  note  that  we 
color  each  vertex  only  once  since  after  finding  a candidate  pair  we 
continue  the  coloring  of  the  path  where  we  left  off.  Since  there  are  p 
vertices  (p  is  0(m))  on  the  path,  the  whole  process  in  this  step  is  of 
0(m) . 

We  now  describe  and  analyze  the  order  of  Steps  1 and  3 for  the  two 
special  cases,  namely  minisum  and  minimax. 

2.2.1  The  Vertex  Restricted  Minisum  Problem 

First  we  concentrate  on  the  minisum  version.  The  single  facility 
problems  of  Step  1 are  1-median  problems  which  can  be  solved  in  0(m)  time 
using  Goldman's  (1971)  algorithm.  We  can  also  use  Goldman's  algorithm  to 
"trim"  the  tree  so  that  only  the  path  between  the  two  unconstrained 
optima  is  left.  By  Lemma  2.2  we  know  that  there  is  at  least  one  optimal 
solution  to  the  original  problem  on  this  path.  The  initial  problem  is 
equivalent  to  the  problem  on  the  "trimmed"  tree  T',  if  we  use  the 
following  "trimming"  procedure  due  to  Goldman  (1971): 
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T'  = T 

while  there  exists  a tip  i of  T'  with  vertex  j adjacent  to  vertex  i 

and  vertex  i not  on  PCx^.x^)  choose  tip  vertex  i do 

[update  the  weights  of  vertex  j]  w^  = w^+  w-q; 

w = w + w ; 
j2  j2  i2 

delete  vertex  i and  arc  (i,j)  from  T’, 

end. 


This  process  requires  0(m)  effort,  since  each  vertex  is  considered 

at  most  once  before  being  deleted.  For  the  objective  function  value 

computations  of  Step  3,  we  assume  that  the  complete  distance  matrix  is 

given.  We  can  compute  the  objective  function  value  for  one  candidate 

pair  in  0(m)  time.  To  evaluate  the  other  pairs  we  use  the  directional 

derivatives,  which  can  again  be  computed  in  0(m)  time  using  the  method 

described  in  Francis  and  White  (1974).  In  computing  the  objective 

function  values  successively,  each  directional  derivative  will  be  used  at 

most  once,  and  hence,  all  remaining  pairs  can  be  evaluated  in  linear 

time.  Note  that  the  overall  effort  for  this  version  of  the  algorithm  is 

0(m) , which  is  the  same  as  the  effort  necessary  for  the  unconstrained 

version  of  the  problem,  namely  two  independent  1-median  problems.  We 

finally  remark  that  if  the  full  distance  matrix  is  not  given  then  we  can 

still  find  the  optimal  solution  in  linear  time,  but  to  compute  the 

2 

optimal  objective  function  value  we  may  need  0(m  ) effort.  We  now  give 
an  example  of  this  procedure.  Adjacent  to  each  vertex  j is  a pair 
(w.^w^)  giving  the  weights  for  new  facilities  1 and  2. 
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Step  1 • Solve  the  two  1-median  problems  separately: 
(x^.x^)  = (7,12),  with  dCx^.x^)  = 11  > 6 = re- 
construct T'  from  T (T'  = PCx^.x^)) — Trimming — : 


33,12  5,6  6,6  2,4  2,2  12,32 


Step  2:  k = 1,  i = 7 (We  keep  the  same  vertex  numbers.) 

Starting  at  vertex  7,  color  6 units  of  the  path  to  the  right.  The 
last  point  colored  coincides  with  vertex  9,  thus  the  first 
candidate  pair  is  (7,9);  k = 2;  i = 8. 

Extend  the  coloring  to  the  point  that  is  6 units  away  from  vertex 
8.  The  last  point  colored  coincides  with  vertex  11;  thus  the 
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second  candidate  pair  is  (8,11);  k = 3;  i = 9. 

Extend  the  coloring  to  the  point  that  is  6 units  away  from  vertex  9 
or  until  vertex  12  is  colored.  Since  vertex  12  is  colored,  the 
final  candidate  pair  is  (9,12). 

Step  3:  g(7,9)  = 33*0+5*2+6*6+2*7+2*8+12*11+ 

13*6+6*4+6*0+4*1+2*2+32*5  = 478. 

33,13  5,6  6,6  2,4  2,2  12,32 

0 © ®— ®— © © 

2 4 11  3 


The  directional  derivatives 


D1: 

6 

16 

28 

32 

36 

D2: 

-37 

-25 

-13 

-5 

-1 

Thus 

g(8, 11)  = g(7,9)+D1(7,8)d(7,8)+ 

D2(9, 10)d(9, 10)+D2(10, ll)d( 10, 11) 

= 478  + 6 * 2 + 

(-13)  * 1 + (-5)  * 1 = 472. 

g(9, 12)  = g(8, ll)+D1(8,9)d(8,9)+D2(ll , 12)d( 11,12) 

=472  +16  * 4 + (-1)  * 3 = 533. 

The  optimal  locations  are  x^  =8,  x^  = 11. 

(Note  that  pairs  (7,8),  (7,9),  (8,9),  (8,10),  (9,10),  (9,11), 
(10,11),  (10,12)  and  (11,12)  have  not  been  considered  due  to 
Lemma  2.2.  Furthermore,  pairs  (7,10),  (7,11),  (7,12)  and  (8,12) 
are  not  feasible.) 
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2.2.2  The  Vertex  Restricted  Minimax  Problem 

We  now  turn  our  attention  to  the  minimax  version  of  the  problem 

and  state  the  orders  of  steps  1 and  3. 

The  single  facility  problems  to  be  solved  in  Step  1 are  1-center 

problems  that  can  be  solved  using  the  Dearing  and  Francis  (1974b) 

2 

algorithm  in  0(m  ) time.  In  the  minimax  version  we  do  not  have  a vertex 

optimality  property;  thus  we  cannot  expect  the  optimal  locations  to  be  at 

the  vertices.  We  use  the  expression  vertex  center  as  in  Handler  and 

Mirchandani  (1979)  to  differentiate  between  the  absolute  center  of  a tree 

and  the  center  that  is  restricted  to  be  on  the  vertices  of  the  tree.  The 

Dearing  and  Francis  (1974b)  algorithm  provides  the  unique  absolute  center 

for  each  of  the  two  separate  problems.  If  the  absolute  center  is 

interior  to  an  arc,  then  we  can  find  the  vertex  center  by  evaluating  the 

objective  function  on  the  two  vertices  incident  to  that  arc  and  taking 

the  vertex  with  the  lower  objective  function  value.  With  the  above 

described  addition  to  the  algorithm,  the  unconstrained  (but  restricted) 

optima  and  the  path  between  them  is  well  defined.  In  Step  3,  each 

candidate  pair  can  be  evaluated  by  finding  the  farthest  vertex  (in  the 

weighted  sense)  from  each  new  facility,  which  takes  0(m)  effort  for  each 

pair.  Since  there  are  0(m)  candidate  pairs,  all  pairs  can  be  evaluated 
2 

in  0(m  ) time.  Thus  the  overall  effort  for  this  version  of  the  algorithm 
again  is  the  same  as  the  effort  needed  to  solve  an  unconstrained  single 
facility  problem.  (In  passing  we  remark  that  there  are  theoretically 
lower  order  algorithms  to  solve  the  1-center  problem,  such  as  the 
O(mlogm)  Kariv  and  Hakimi  (1979a)  algorithm  and  the  0(m)  Megiddo  (1982) 
algorithm. ) 


We  now  give  an  example  of  the  procedure  for  the  minimax  case: 


10,4  26,1  5,1  2,35  1,12  2,12 


Step  1:  x^  is  between  1 and  2,  1/6  units  away  from  2,  x^  is  at  5. 
f^v^  = w21d(v1,v2)  = 26*3  = 78 

f 1 ( v2 ) = w^d(v2,v^)  = 10*3  = 30,  thus  the  unrestricted  vertex 
center  for  the  first  facility  is  at  vertex  2.  Since  for  the  second 
facility,  the  center  is  on  vertex  5,  we  restict  ourselves  to  the 
path  P(v2,v5). 

Step  2:  For  r,^  = 5 the  candidate  pairs  are:  (2,4)  and  (3,5). 


Step  3:  For  a given  center  location  x^  we  denote  a farthest  vertex  (in 

the  weighted  sense)  by  fv  . 

J • 


2’  4' 


(2,4): 

fvi  = 

1, 

fl(v2) 

= w11d(l,2) 

= 30; 

II 

CN 

> 

4-1 

6, 

W 

= w&2d(6,4) 

= 48; 

(3,5): 

fvl  = 

2, 

w 

= w21d(2,3) 

= 52; 

fv2  = 

1, 

^LO 

> 

CN 

4-1 

= w12d(l,5) 

= 36; 

3’  5; 


Thus  the  optimal  locations  are  on  vertices  2 and  4. 
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2.3  The  Vertex  Unrestricted  Problem 

In  this  part  of  the  chapter  we  study  the  vertex  unrestricted 
version  of  the  2-facility  problem  with  a distance  constraint  between  the 
two  new  facilities.  The  solution  space  is  the  entire  tree,  as  opposed  to 
being  limited  to  the  set  of  vertices  as  in  Sections  2.2.  We  first 
motivate  and  formally  state  the  general  algorithm,  and  then  focus  on  the 
minisum  and  the  minimax  versions  in  Sections  2.6  and  2.7  respectively. 

TREE- 2; 

Step  1:  Find  the  optimal  locations  of  the  two  separate  unconstrained 

single  facility  problems  and  construct  the  path  between  these  two 
locations. 

Step  2:  Construct  P2'  on  this  path,  a 2-facility  problem  with  addends, 
that  is  equivalent  to  the  original  problem,  P2. 

Step  3:  Construct  PI,  a single  facility  problem  with  addends  on  a path, 
that  is  equivalent  to  P2'. 

Step  4:  Solve  the  single  facility  problem  constructed  in  Step  3. 

Before  we  describe  the  two  special  versions  of  this  algorithm,  we 
discuss  the  common  steps,  namely  Steps  2 and  3 in  more  detail.  We  first 
explain  Step  2. 

We  have  shown  in  Lemma  2.1  that  there  is  an  optimal  solution  to 
the  problem  on  PCx^x^),  and  thus  the  problem  reduces  to  a problem  on  a 
path.  We  now  describe  a procedure  that  constructs  a 2-facility  problem 
P2'  on  PCx^.x^)  that  is  equivalent  to  P2.  Suppose  f-^  and  are 
functions  of  weighted  distances  (such  as  in  the  minisum  and  minimax 
models).  The  weighted  distance  between  new  facility  j and  existing 
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facility  r is  jd(Xj , vr) . Suppose  vr  is  not  on  PCx^x^)  and  denote  the 


.vertex  on  P(x^,x^)  closest  to  v by  v'.  By  Lemma  2.1  there  exists  an 
12  r J r J 


optimal  location  of  x^.  on  PCx^.x^).  Since  the  unique  path  from  v^.  to  x^. 
(on  PCx^.x^))  goes  through  , we  have 

d(x j » vr ) = d(xj»vp  + d( vr ’ Vr ) * Thus 
wrjd(Xj,vr)  = wrj{d(Xj,vp  + d(vr,vp) 

= w ,d(x  .,v’ ) + h .. 
rj  j’  r y rj 

(Note,  if  v^  is  on  P^^.x^)  then  vr  = v^  and  the  above  equation  still 
holds. ) 

The  contribution  of  the  existing  facility  at  vertex  v^  to  f ^ is 

equal  to  the  contribution  of  an  existing  facility  located  at  vertex  v' 

with  the  same  weight  w . and  an  addend  of  h . (h  . = w ,d(v  ,v')).  Thus 

rj  rj  rj  rj  v r’  r 

we  can  insert  a "new"  existing  facility  at  vertex  v'  and  disregard  the 
"old"  existing  facility  at  vertex  v . We  thus  obtain  a 2-facility 
problem  on  that  is  equivalent  to  P2. 

As  a convention,  in  the  following  statement  of  the  Path  Reduction 
Procedure  we  assume  that  existing  facility  i is  located  on  vertex  i 
throughout  the  process.  Thus  we  can  imagine  that  we  relocate  vertices, 
not  existing  facilities,  and  we  allow  more  than  one  vertex  at  the  same 
location,  corresponding  to  different  existing  facilities.  Consequently, 
we  define  the  "auxiliary"  weight  u^  . to  be  the  sum  of  the  weights  (with 
respect  to  new  facility  j)  of  all  vertices  that  are  relocated  to  the  same 


location  as  vertex  i. 


Path  Reduction  Procedure 


h . , =0;  h. ~ = 0;  u . . = w.  . ; 
ll  i2  ij  ij 
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p = the  number  of  vertices  on  P(x^,X2); 
if  p < m then  (for  p = m no  reduction  is  necessary) 
while  there  exists  a tip  not  on  PCx^.x^)  do 

Vj  : the  vertex  adjacent  to  v_^  (d(v^,v^)  > 0); 
[relocate  the  vertex  v_^  at  v . ] ; 

hjl  = hji  + hn  + uild(  vi » v j ) ; 

hj2  = hj2  + h.2  + ui2d(vi,vj); 

delete  arc  (v.,v.)  from  T; 
i 3 

Ujl  = ujl  + uif> 

uj2  = uj2  + ui2; 

end 

endif 


Note  that  each  arc  not  on  PCx^.x^)  is  considered  once  and  the 
number  of  the  arcs  on  T is  m-1 . Thus,  if  the  incidence  numbers  of  the 
vertices  of  T are  given,  as  well  as  a list  of  vertices  on  P(x^,x2)  then 
the  effort  necessary  for  this  transformation  procedure  is  of  0(m). 

We  now  describe  how  we  can  transform  P2'  we  constructed  in  Step  2, 
to  PI  an  equivalent  single  facility  problem  (Step  3). 

In  the  proof  of  Lemma  2.3,  we  used  the  fact  that  ^2  = ^1  + ri?' 

We  thus  have  | y2  - a^ | = |y^  + r^2  - a_J  . Defining  b^  = a^  - r^  for 
all  i,  we  have  |y2  - a.J  = |y^  - b.|.  Thus  the  weighted  distance  terms 
for  new  facility  two  (w^ly^  - a_J  ) are  replaced  by  w-^2  ^ 1 “ ^ | in  the 
objective  function  f2<  To  accommodate  these  new  terms  involving  y^  we 
will  modify  the  path  P^^.x^).  Denote  the  weights  of  PI  by  w j , the 
the  addends  by  h|.  In  this  transformation,  we  extend  the  path  P^^.x^) 
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beyond  and  x^.  We  can  make  this  extension,  since  the  problem  on  the 
path  is  equivalent  to  a problem  on  the  line. 


Path  Extension  Procedure 


j=m+l 


for  i = 1 to  n do 


wi  " wil; 
h!  = hn; 


[insert  new  vertex  v a distance  of 
r^  units  to  the  left  of  v^ ] ; 

wj  = wi2; 

h[  ' hi2> 

j = j + 1 


end 


This  procedure  constructs  a problem  with  twice  as  many  vertices  as 
Ptx^.x®)  contains.  We  replicate  each  original  vertex  by  inserting  a new 
vertex  that  is  r^  units  farther  away  from  x^  than  its  original 
counterpart.  These  new  vertices  carry  the  weights  and  addends  of  the 
original  vertices  with  respect  to  new  facility  two.  The  original 
vertices  of  P2'  are  left  with  the  weights  and  addends  with  respect  to 
new  facility  one.  The  optimal  location  x , of  the  single  facility  for  PI 
is  also  the  optimal  location  of  new  facility  one  for  P2'  (and  P2).  The 
optimal  location  of  new  facility  two  of  P2'  (and  P2)  is  r^  units  away 
from  x^,  towards  x^. 

We  consider  each  vertex  exactly  once  and  replicate  it.  Since 
there  are  m vertices  and  the  replication  process  requires  constant 
effort,  the  total  effort  needed  for  this  transformation  is  0(m) . We  now 
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discuss  the  two  special  versions  of  this  algorithm  and  give  an  example 
for  each. 

2.3.1  The  Vertex  Unrestricted  Minisum  Problem 

The  single  facility  problems  of  Step  1 are  1-median  problems  that 
can  be  solved  using  Goldman's  (1971)  0(m)  algorithm. 

In  Step  2,  we  transform  P2  to  P2',  a problem  on  a path,  using  the 
Path  Reduction  Procedure.  This  transformation  results  in  the  relocation 
of  all  vertices  to  that  path,  where  several  vertices  may  coincide  after 
the  relocation.  Since  f^  and  f2  are  summation  functions,  we  can  use  a 
modification  of  Goldman's  1-median  algorithm  for  this  transformation. 

Recall  that  Goldman's  algorithm  reduces  the  problem  at  each  iteration  to 
a smaller  problem  by  deleting  a tip.  and  adding  its  weight  to  the  adjacent 
vertex.  We  use  this  idea  to  reduce  P2  to  a problem  on  a path.  (Note 
that  the  Path  Reduction  Procedure  in  fact  simplifies  to  Goldman's 
algorithm  if  we  do  not  need  to  keep  track  of  the  weights  of  the  vertices 
separately.)  Thus,  the  effort  for  the  transformation  procedure  of  Step  2 
reduces  to  0(m) . 

PI  of  Step  4 is  another  1-median  problem.  The  addends  do  not 
affect  the  optimal  location.  Thus  the  overall  effort  for  the  minisum 
version  turns  out  to  be  0(m) , thanks  to  the  simplification  of  Step  2. 

This  must  be  the  best  possible  order  to  solve  this  problem,  since  the 
order  is  the  same  as  of  the  data. 

We  now  solve  the  following  problem  with  r ^ = 4 using  this 


procedure. 


33 


3,2 


Step  1:  = 3 and  = 5,  with  dCx^.x^)  = 8 > 4 = r^. 

Step  2:  We  "relocate"  1 and  2 at  3,  6 at  4,  7,8,9,10  at  5.  Only  showing 
the  vertices  3,4  and  5 and  the  auxiliary  weights  at  vertices  3,  4 
and  5,  we  have  the  following  equivalent  problem. 

G>— ^ 1 © 

26,8  5,6  16,25 


Step  3:  We  construct  PI  by  duplicating  the  vertices  and  extending  the 
path.  The  copies  of  vertices  3,  4 and  5 are  6,  7 and  8 
respectively.  The  dotted  arrows  indicate  the  copying  of  vertices. 


8 6 26  5 25  16 

0 T T 

Step  4:  x =4.  Thus  x^  = 4,  x ^ between  4 and  5,  4 units  away  from  4. 
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As  a result  of  the  vertex  optimality  property  of  the  1-median 
problem  and  our  transformation  of  P2  to  PI  (via  P2f)  we  have  the 
following  Lemma: 

Lemma  2.5:  In  an  optimal  solution  to  P2,  the  vertex  unrestricted 
2-facility  minisum  problem  with  a distance  constraint,  at  least  one  of 
the  optimal  locations  is  at  a vertex  of  the  tree. 

Proof : We  solve  P2  by  solving  PI  on  the  extended  path  and  then 
locate  x^  at  x^,  the  optimal  location  to  PI,  and  let  X2  be  at  a point  r^ 
units  away  from  x^.  Due  to  the  vertex  optimality  property  of  the  1- 
median  problem  we  know  that  there  exists  an  optimal  solution  to  PI  on  a 
vertex.  Suppose  that  vertex  has  an  index  j <_  m.  Then  x^  is  on  an 
original  vertex  of  P2  and  thus  x^  is  located  at  a vertex  of  P2.  Now 
assume  x®  is  at  a vertex  with  an  index  j > m.  In  this  case,  x^  is 
located  at  a "new"  vertex,  that  is  not  an  original  vertex  of  P2.  But  x^ 
is  located  at  the  original  vertex  with  index  j-m,  since  the  vertex  j is  a 
replication  of  the  original  vertex  j-m,  by  the  transformation  of  P2'  to 

Pl.[] 

2.3.2  The  Vertex  Unrestricted  Minimax  Problem 

The  single-facility  problems  of  Step  1 are  1-center  problems,  and 
the  single  facility  problem  of  Step  3 is  a 1-center  problem  with  addends. 
All  of  these  problems  can  be  solved  by  the  Dearing  and  Francis  (1974b) 
algorithm.  We  note  that  there  also  is  an  algorithm,  due  to  Goldman 
(1972),  to  solve  the  unweighted  1-center  problem  with  addends. 

We  cannot  use  a simplification  of  Step  2,  as  in  the  minisum  case, 
to  bring  the  order  down  to  0(m).  Given  that  two  existing  facilities  are 
at  the  same  vertex,  we  can  ignore  one  of  them  in  P2'  only  if  its  weight 
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and  addend  are  smaller  than  the  weight  and  the  addend  of  the  other  one. 

This  may  not  always  be  the  case.  Thus  the  total  effort  needed  to  solve 

2 

the  minimax  version  is  0(m  ) , which  is  also  the  effort  required  to  solve 
the  1-center  problem  with  addends  in  Step  4. 

We  now  solve  the  problem  in  Section  2.2.2  using  this  procedure 
with  r^2  = 5. 


10,4  26,1  5,1  2,35  1,12  2,12 


Step  1:  is  between  vertices  1 and  2,  5/6  units  away  from  vertex  2, 

ff(x^)  = w]^d(v^,x^)  = w^d(v2,x^)  = 85/3;  x^  is  at  vertex  5, 
f2(x°)  = wi2d(v1»x2)  = w62d(v6,X2>  = 36. 
d(xi ’X^)  = 41/6  > 5 = ri2 

Step  2:  Construct  P2 ' , the  problem  on  P^^.x^).  Vertices  that  are 
located  at  the  same  point  are  shown  as  touching  each  other. 

We  also  write  the  weights  and  addends  with  respect  to  each 
facility  on  two  different  lines  for  convenience. 
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w. , ; 10  26  4 5 1 1 

h1!:  130/6  04  012 

wj2:  4 11  131 

h 2;  52/6  0 1 0 3 2 


2 12  1 
0 0 6 4 

35  12  12  4 

0 0 36  16 


2 


<D0© ©-y©®@ 


Note  that  vertex  1 is  relocated  at  x^.  Furthermore,  vertex  8 is 
relocated  at  2,  7 and  9 at  3,  6 and  10  at  5.  The  addends  resulted 
from  these  relocations. 

Step  3:  Construct  PI  from  P2T  using  the  Path  Extension  Procedure: 

(The  copy  of  vertex  i is  indexed  as  i+10) 


weights 

addends 


4 

52/6 


1 1 
0 1 


1 3 1 

0 3 2 


1 

4 


2 

6 


1 

0 


2 

0 


©©©7- <© 


(n>— 

5/6 


1 1 5 

2 1 0 


4 12  12 
16  36  0 


(13X17X19 


13/6 


35  4 26  10 

040  130/6 


<2XzX1)-hS)@©— H©©0— @r 

1 1 5/6 


Step  4:  The  optimal  location  x°  is  between  2 and  16,  2/11  units  away 

T 0 T 

from  16.  In  P2  x^  coincides  with  x and  is  5 units  away  from 
T 

x-^  (it  is  between  4 and  5,  2/11  units  away  from  5).  The  optimal 
objective  function  value  is  420/11  = 38.18.  (Recall  that  for  the 
unconstrained  problem  the  optimal  objective  function  value  was  36 
and  for  the  vertex  restricted  version  it  was  50,  with  the  optimal 
locations  on  vertices  3 and  5.) 
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2.4  The  Mutual  Communication  Problem  and  Other  Applications 


In  this  section,  we  first  turn  our  attention  to  a related  problem, 
namely  the  constrained  2-facility  problem  with  an  added  NN— type  objective 
function  term.  We  denote  the  mutual  communication  factor  between  the  new 
facilities  by  v^ 2 • The  objective  function  of  this  problem  can  be 
expressed  as  g ( f (x1),f2(x2),f12(x1,x2  )),  where  the  new  term 
f12(x1,x2)  = v12d(x1,x2),  and  g is  a nondecreasing  function  of  fp  f2  and 
f^2  We  show  that  with  minor  modifications,  the  algorithms  stated  in 
previous  sections  will  solve  this  problem  as  well.  The  single  facility 
problems  that  are  used  to  find  the  unconstrained  optimal  locations  in 
Step  1 are  replaced  by  a single  2-facility  problem  with  mutual 
communication.  The  minisum  and  minimax  versions  of  this  unconstrained 
problem  can  be  solved  using  Kolen's  (1982)  algorithm,  and  a procedure  due 
to  Francis,  Lowe  and  Ratliff  (1978)  respectively.  We  first  state  a 
result  relating  the  optimal  locations  of  the  separate  unconstrained  1- 
facility  problems  and  the  unconstrained  2-facility  mutual  communication 
problem. 

Lemma  2.6:  Denote  an  optimal  solution  of  the  unconstrained  single 

facility  problem  for  facility  j by  x^.  There  exists  an  optimal  solution 

M M 

of  the  2-facility  mutual  communication  problem,  say  (XpX2),  with 

M , M / 0 Ox 
x^  and  x2  on  P(XpX2). 

Proof : Choose  any  x^  and  x2  not  on  P(xpX2).  For  j = 1 and  2, 

let  Xj  be  the  unique  closest  point  on  P(xpX2)  to  x^.  From  the  proof  of 

Lemma  2.1  we  have  f.(x.)  > f.(x'.)  for  j = 1,2,  and  d(x.  ,x„)  _>d(x’,x'). 

JJJJ  iZ 

The  second  inequality  implies  that  f12(xpx2)  _>  f12(x|,xp. 

Thus  g(f1(x1),f2(x2),f12(x1,x2))  >_  g(f1(xp,f2(x2),f12(XpXp).[] 


We  now  state  and  prove  a result  for  the  mutual  communications 


problem  that  is  similar  to  Lemma  2.1  of  Section  2.1. 

C C 

Lemma  2.7:  There  exists  an  optimal  solution  (x^,x;p  to  the 

C C 

constrained  mutual  communication  problem,  where  x^  and  x^  are  on  the 
path  P ( x^ , x^ ) • 


0 0, 


Proof : Choose  any  x^  and  x ^ not  on  P(x^,X2)  with  d(x^,X2)  <.  r-^- 

For  j = 1 and  2,  let  x^.  be  the  unique  closest  point  on  PCx^.x^)  to  x^.. 
The  rest  of  the  proof  is  essentially  the  same  as  the  proof  of  Lemma 
2.6.  Note  the  proof  of  Lemma  2.6  establishes  that  d(xj,x,p  <_  r^9.[] 


Recall  that  we  used  Corollary  2.1  of  Section  2.1  to  solve  the 
vertex  unrestricted  version  of  the  original  problem.  We  next  state  Lemma 
2.8,  which  is  analogous  to  Corollary  2.1.  We  than  can  use  the  algorithm 
TREE-2  with  minor  modifications  to  solve  the  mutual  communication 
problem. 

M M 

Lemma  2.8:  Assume  f,  f^  and  f2  are  convex.  Let  (x^,X2)  be  an 

optimal  solution  to  the  unconstrained  mutual  communication  problem.  If 

/MM  C C 

d(x^,X2)  > r^2’  then  there  exists  an  optimal  solution  (x^,X2)  to  the 

C C C 

constrained  mutual  communication  problem  such  that  d(x, ,x„)  = r,„  and  x. 

12  12  j 

on  PCx^jX^)  for  j = 1 and  2. 


Proof : Due  to  Lemma  2.7  it  suffices  to  show,  given  any  x^,  X2 


on 


PCx^.x^),  with  d(x^,X2)  = t < r^j  that  there  exists  xj,  x),  on  PCx^.x^) 

M M 

with  dCxjjX^)  = r^  and  f(X')  _<  f(X).  Choose  any  x^  and  on  P(x^,X2) 

✓ x MM  MM 

with  d(x^,X2)  < r^  and  d(x^,x^)  <^d(x^,X2).  (For  if  d(x^,x^)  > d(x^,X2) 

then  fCx.^^)  >_  f(x2,x1)  due  to  convexity  of  f^  and  f 2- ) As  in  Dearing, 

Francis  and  Lowe  (1976)  we  define  the  set  of  locations 
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j = 1,  2 } for  0 < a < 1.  Let  L(X,XM)  = u { L (X,XM)  : 0 < a < 1 } , 

3.  — 

M 

which  we  call  the  line  segment  joining  X and  X . Denote  the  distance 

between  the  entries  in  Y(a),  where  Y(a)  is  the  unique  element  of 

M MM 

La(X,X  ),  by  s(a).  Note  that  s(0)  = t < r ^ and  s(l)  = d(x^,x2)  > r^. 

Since  s is  a continuous  function,  by  the  intermediate  value  theorem, 

there  exists  some  value  of  a,  say  a , for  which  s(a  ) = r^2 . Construct 

X'  = Y(a  );  we  have  d(xj,x,p  = r^.  Clearly  (x^xp  is  on  P(x^,x2), 

since  (x^.x^)  is  on  PCx^.x^)  by  Lemma  2.6  and  (x1,x2)  is  on  P(x^,x2)  by 

assumption.  Furthermore,  f(X  ) _<  f(X')  _<  f(X)  since  f is  a convex 

function,  nonincreasing  along  any  "line  segment"  leading  to  a global 

M M 

minimum,  X is  a global  minimum  of  f,  and  X is  on  L(X,X  ).[] 

Note  that  Lemma  2.8  implies  that  the  mutual  communication  factor 

M M 

in  the  objective  function  is  not  relevant,  provided  that  dCx^.x^)  > r 2> 

T T 

Since  we  know  that  there'  is  an  optimal  solution  with  d(x^,x2)  = r^2>  we 
can  treat  the  NN-part  of  the  objective  function  as  a constant,  r^2vl2 
Due  to  Lemma  2.8,  the  problem  can  be  reduced  to  a 1-facility  problem 
using  the  Path  Reduction  and  the  Path  Extension  Procedures  described  in 
Section  2.3;  the  general  algorithm  TREE-2  stated  in  the  same  section 
can  be  used  to  solve  the  mutual  communication  problem. 

We  now  turn  our  attention  to  a different  problem.  In  previous 
sections,  we  studied  versions  of  the  2-facility  problem  with  a distance 
constraint  where  f-^,f2  and  8 are  either  summation  functions  or 
maximization  functions.  In  general,  there  is  no  requirement  that  f^, 
and  g need  to  be  the  same  type  of  function.  As  long  as  the  assumptions 
of  the  lemmas  are  satisfied,  we  can  use  any  functions  for  f^,  f2  and  g. 
Thus  there  are  many  more  applications  which  can  be  solved  by  the  general 
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procedures  outlined  in  this  chapter.  As  an  example,  following  Halpern 
(1976)  we  study  a problem,  where  is  a summation  function,  f2  is  a 
maximization  function  and  g is  a convex  combination  of  these.  Thus,  for 
s (0,1)  the  problem  can  be  stated  as 

min  g(f1(x1),f2(x2))  = (s)f1(x1)  + (l-s)f2(x2), 
where  f-^(x^)  = E { w_^d(x^,v^)  : i = 1,  ...,  m } and 
f2(x2)  = max  { d(x2,v^)  : i = 1,  ...,  m }, 
s.t.  d(x^  ,x2)  <_ 

Denote  the  minimizer  of  f ^ by  x^  for  j = 1,2.  We  can  again 
reduce  the  problem  to  the  line  segment  between  x^  and  x^  using  the  Path 
Reduction  and  the  Path  Extension  Procedures.  Making  the  substitution 
d(x2,Vi)  = d(x1,vi)  + r12  reduces  the  2-facility  problem  to  a single 
facility  problem.  Denote  the  point  that  is  r^2  units  to  the  left  of  x^ 
by  c.  Replace  f2(x„)  by  d(x^,c)  + h,  where  h is  a constant  (h  = f2(x2))* 

We  then  have  the  following  1-median  problem: 

min  { E w^d(x^,v^):  i = 1,  ...,  m)  + ((l-s)/s)d(x^ ,c) . 

Note  that  in  the  above  1-median  problem,  there  is  one  more  vertex 
in  addition  to  the  original  vertices  of  the  problem.  The  new  vertex  is 
inserted  between  the  two  unconstrained  optima,  r^2  units  closer  to  the  1- 
median  than  the  1-center  is,  with  a weight  of  (l-s)/s.  Halpern  (1976) 
studied  this  problem  for  r12  = 0 as  a multiobjective  single  facility 
problem  and  called  the  optimal  location  a "cent-dian".  Handler  (1985) 
preferred  the  term  "medi— center"  for  this  facility . The  discussion  above 
in  a sense  generalizes  Halpern 's  result  to  the  case  r^2  > 0. 


CHAPTER  3 

MULTIFACILITY  MINIMAX  PROBLEMS  WITH  DISTANCE  CONSTRAINTS 


This  chapter  deals  with  the  multifacility  version  of  the  principal 
2-facility  minimax  problem  studied  in  Chapter  2.  As  discussed  in  Chapter 

1 , minimax  models  are  more  appropriate  if  the  general  approach  is  more 

conservative  or  pessimistic.  For  convenience  we  restate  the  problem. 

The  objective  is  to  minimize  the  maximum  weighted  distance  between 
existing  and  new  facility  pairs,  with  upper  bounds  imposed  on  the 
distance  between  pairs  of  new  facilities.  We  can  formulate  the  problem 
as  follows: 

min  { max  { w_^d(Xj,v^):  i = 1,  ...,  m;  j = 1,  ...,  n }, 

s.t.  d(Xj , xfc)  <_  rjk,  j,k  =1,  ...,  n,  j < k, 

or  min  z, 

s.t.  d(XjtV;L)  1 z/w_  f°r  w > 0;  i = 1 , ...,  m;  j = 1,  ...,  n, 

d(xj ,xk)  — rjk’  • • •>  n,  j < k. 

Note  that  the  problem  is  separable  if  we  have  no  upper  bounds  on 

the  distances  between  the  new  facilities.  In  that  case,  it  can  be  solved 

by  solving  n single  facility  problems,  using  an  appropriate  algorithm 

2 

such  as  Dearing  and  Francis  (1974b),  which  is  0(m  ).  Thus  the  total 

2 

effort  to  solve  the  unconstrained  problem  would  be  0(nm  ).  This  order 
could  be  reduced  by  using  the  algorithms  of  Kariv  and  Hakimi  (1979a),  or 
Megiddo  (1982). 

We  discuss  several  solution  procedures  for  this  problem,  all  of 
which  use  the  separation  conditions,  due  to  Francis,  Lowe  and  Ratliff 
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42 

(1978).  On  a tree  network,  these  researchers  have  studied  multifacility 
location  problems  with  distance  constraints,  which  they  define  as 
follows : 

d(Xj,Vi)  C;L  .,  1 <.  i <.  m,  1 < j < n, 
d(xj,xk)  <_  bjk,  1 <.  j < k <_  m. 


These  constraints  are  consistent  if  and  only  if  there  exists  at 

least  one  set  of  locations,  X,  satisfying  all  of  these  constraints. 

Corresponding  to  these  constraints  they  define  the  network  BC  to  be  the 

undirected  network  with  a node  for  each  existing  facility  and  a node 

N for  each  new  facility.  For  each  c.  . > 0,  N.  and  E.  are  connected  with 
J ij  J i 

an  arc  of  lenth  c^.;  for  each  b^  > 0,  N and  are  connected  with  an 

arc  of  length  b . For  notational  convenience  we  partition  the  arc  set 

into  two  sets  A and  A„  with  A„  = ( (N.,N.  ) : b > 0 } and 
B C B j k jk 

= { (Nj,E^):  c^  . > 0 }.  We  also  partition  the  network  BC  into 
networks  B and  C,  where  the  network  B consists  of  the  nodes  N.  and  the 


J 

arcs  of  A_,  while  network  C consists  of  nodes  E.  and  has  no  arcs.  Note 
B i 

that  the  arcs  in  A^  connect  networks  B and  C.  For  the  purposes  of  the 
following  analysis  we  assume  that  network  BC  is  connected.  This 
assumption  is  not  a limitation,  since  a disconnected  network  BC  can  be 
decomposed  into  smaller  networks,  each  of  which  is  connected. 


connecting  E^  and  E ^ , by  LP(E^,Ej)  the  length  of  the  path,  and  by 
L(E^,E.)  the  length  of  any  such  shortest  path.  It  is  proven  by  Francis, 
Lowe  and  Ratliff  (1978)  that  necessary  and  sufficient  conditions  for  the 
consistency  of  the  distance  constraints  are 
d(v  ,v  ) 1 L(E  ,E  ),  1 _<  s < t _<  n. 

These  inequalities  are  called  the  separation  conditions. 
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Our  constraints  are  in  the  form 


d(x.,v.)  < z/w.  . for  w.  . > 0,  1 < i < m,  1 < j < n, 

J i - ij  ij  - - - - J ~ 

d(Xj,xk)  rjk’  1 <.  j < k <_  m. 

Thus  in  the  corresponding  network  BC  , for  a given  z the  length  of  the 


arc 


between  E.  and  N.  with  w.  . > 0 is  z/w.  and  between  N.  and  N,  is 
1 J ij  ij  J k 


r ..  . If  w.  . = 0 then  there  is  no  arc  between  E.  and  N., 
Jk  ij  i J 


W, 


Associated  with  any  path  P(Es>Et)  we  define  the  following  terms: 
j(Eg,Et)  is  the  sum  of  the  arc  lengths  r^,  over  arcs  in  Ag  flP(Eg,Et); 
W^,(E  ,Et)  is  defined  such  that  zW^(Es,Et)  is  the  sum  of  the  arc  lengths 
z/w  over  arcs  in  A^  f)  P(Eg,Et).  We  have  Wg(Eg,Et)  _>  0,  with  Wg  = 0 if 
and  only  if  the  path  P(Eg,E  ) passes  through  no  arcs  in  Ag.  Also 

W„(E  ,E  ) > 0,  since  each  path  between  E and  E contains  at  least  2 arcs 

in  A^,  (recall  network  C has  no  arcs  ). 

Using  the  two  terms  that  we  just  defined,  we  can  express  the 
length  of  any  path  P(E  ,E  ) as  LP  (E  ,E  ) = zW„(E  ,E  ) + WR(E  ,E  ).  We 
call  a path  a tight  path  if  for  some  z,  LPz(Eg,Et)  = d(vg,vt)  and  a 
violated  path  if  for  some  z,  LPz(Es>Et)  < d(vg,vt).  We  also  denote  the 

length  of  a shortest  path  between  E and  E by  L (E  ,E  ). 

S U ZSL 

In  some  of  the  solution  procedures  we  suggest  in  this  chapter,  we 
use  upper  and  lower  bounds  on  the  objective  function  of  our  problem.  In 
the  next  section  we  state  procedures  to  find  these  bounds. 


3.1  Initial  Lower  and  Upper  Bounds 

We  can  compute  an  upper  bound  on  z by  finding  a feasible  solution 
to  the  problem.  (Note  a feasible  solution  always  exists.)  Since 
locating  all  new  facilities  at  the  same  vertex  (any  vertex  of  the  tree) 
corresponds  to  r = 0 for  all  j and  k,  we  can  get  a feasible  solution 
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that  way.  Since  all  weights  and  distances  in  the  problem  are 

nonnegative,  zero  is  certainly  a lower  bound  on  z. 

However,  in  all  line  search  techniques  we  know  of  the  length  of 

the  search  interval  after  a given  number  of  iterations  is  a strictly 

increasing  function  of  the  initial  interval  length.  Specifically,  for 

bisection  search  the  interval  of  uncertainty  is  reduced  to  some  value 

after  log2(LQ/L^,)  iterations,  where  Lq  is  the  length  of  the  initial 

interval,  the  difference  between  z^  and  z,  , the  initial  upper  and  lower 

bounds  on  z.  We  use  the  following  bounds  to  start  the  search,  since  a 

smaller  value  of  Lq  results  in  fewer  iterations. 

To  find  a lower  bound  on  z,  we  solve  n separate  1-center  problems. 

Denoting  the  optimal  objective  function  value  of  the  problem  for  new 

facility  j by  z.,  we  have  zT  = max  { z.  : j = 1,  ...,n}.  Note  that  we 

J L J 

.use  the  solution  to  the  unrestricted  problem  here,  or,  in  terms  of  our 
model,  we  use  r ,^'s  greater  than  the  length  of  the  longest  path  of  the 
tree.  For  nontriviality  of  the  problem,  the  feasible  solution  with  value 
z = Zq  should  not  satisfy  the  distance  constraints.  We  now  state  this 
procedure  formally. 


Lower  Bound  Procedure: 
for  j = 1 to  n do 

solve  a 1-center  problem  for  new  facility  j,  and 
let  Zj  be  the  optimal  objective  function  value 

end 

zT  = max  { z . : j = 1 , . . . , n } 

L J 


For  the  upper  bound,  we  define  w^  = max  { w . : j = •••»  n } for 

each  existing  facility  and  solve  a 1-center  problem  with  weights  {w_^}. 


The  optimal  objective  function  value  of  this  problem  is  an  upper  bound  on 
z.  Note  that  this  method  is  in  effect  equivalent  to  solving  our  problem 
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with  r 


jk 


= 0 for  all  j and  k. 


Upper  Bound  Procedure: 

for  i = 1 to  n do 

w . = max  { w . . : j = 1 , . . . , n } 
i ij  J 

end 

solve  a 1-center  problem  with  weights  {w_^},  and 
let  z'  be  the  optimal  objective  function  value 


We  can  find  these  bounds,  that  are  sharper  than  the  bounds  we 
mentioned  earlier,  with  little  effort.  We  need  to  solve  a total  of  n+1 
single  facility  problems  using  a 1-center  algorithm.  We  now  proceed  to 
the  algorithms. 


3.2  The  Line  Search  Procedure 

Since  the  separation  conditions  are  necessary  and  sufficient 

conditions  for  the  consistency  of  the  distance  constraints,  for  a given  z 

we  can  determine  whether  the  distance  constraints  are  consistent  or  not 

by  finding  the  shortest  paths  between  all  (E^,E.)  pairs  in  network  BC. 

3 

Thus  any  all-shortest-paths  algorithm,  such  as  Floyd's  (1962)  0((n+m)  ) 
algorithm,  can  be  used  to  check  the  feasibility  of  the  constraint  set  of 
our  problem. 

However  we  can  also  use  a lower  order  procedure  to  check  the 
consistency  of  the  distance  constraints  for  a given  value  of  z.  Francis, 
Lowe  and  Ratliff  develop,  in  the  same  reference  as  above,  a procedure 


46 


which  attempts  to  locate  the  new  facilities  satisfying  the  distance 
constraints.  The  procedure  either  terminates  with  a feasible  solution  or 
determines  that  no  feasible  solution  exists  for  a given  z.  They  call 
this  procedure  the  sequential  location  procedure  (SLP).  We  prefer  to  use 
SLP,  since  it  not  only  checks  the  feasibility  but  also  constructs  a 
feasible  set  of  locations  if  one  exists.  Also  its  order,  being 
0(mn+n  ),  is  the  same  as  the  order  of  the  problem  data.  The  order  of  SLP 
is  lower  than  those  of  the  matrix  algorithms  for  finding  all  shortest 
paths. 


To  solve  our  problem  we  need  to  find  the  lowest  value  of  z, 

n* 

denoted  by  z , for  which  the  distance  constraints  are  consistent  (or 

equivalently  the  separation  conditions  hold).  Since  we  have  a systematic 

way  of  checking  for  the  consistency  of  the  distance  constraints  for  a 

* 

given  value  of  z,  we  can  search  for  z by  trying  different  values  of  z. 

In  a way,  we  have  a one  dimensional  optimization  problem  that  we  can 
solve  using  a line  search  technique. 

Many  search  techniques  are  available;  let  us  consider  using 
bisection  search.  We  need  an  interval  over  which  the  search  is  to  be 
performed.  We  compute  a lower  and  an  upper  bound  on  the  value  of  the 
objective  function  using  the  procedure  described  in  Section  3.1. 

Denoting  the  z value  at  iteration  i by  z(i)  and  a target  length  for  the 
uncertainty  interval  by  E we  now  state  the  bisection  search  procedure 
for  this  problem.  (In  this  and  all  other  algorithm  statements  we  assume 
that  the  distance  matrix  D = (d(v^,v^))  is  given  as  data.) 
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Bisection  Search  Procedure: 
i = 1; 

while  (zy-zL)  > E do 

z(i)  = (zu-zl)/2; 

find  (Eg,Et)  using  Floyd's  all-shortest-paths  algorithm 

for  all  s and  t; 

if  iJz(i)(Es»Et)  >.  d(vg,vt)  for  all  s and  t then 

[or  equivalently,  if  SLP  constructs  a feasible  solution  then]; 

ZU  = z(i); 

else 

ZL  = z(i); 

endif 
i = i+1 ; 

end 

Theoretically  the  search  procedure  is  infinite,  since  (both  of) 
the  bounds  will  go  to  z as  the  number  of  iterations  goes  to  infinity. 
However  at  each  iteration,  z^  describes  a feasible  solution.  Thus  after 
we  reach  a predetermined  iteration  count  or  a target  length  for  the 
search  interval,  we  can  terminate  with  z = z^,  a near-optimal  solution. 

In  order  to  find  a bound  on  the  number  of  iterations  for  a given 
E,  we  could  "scale"  the  problem  by  dividing  each  weight  by  the  largest  of 
all  weights  and  dividing  each  arc  length  by  the  diameter  (the  length  of 

the  longest  simple  path)  of  the  tree.  Consequently,  the  maximum  possible 

weigthed  distance  would  be  one.  For  bisection  search  L^,  the  length  of 
the  uncertainty  interval  after  k iterations  is  given  by  Lq/2^,  where  k is 

the  smallest  integer  greater  than  log0(Ln/L,  ).  For  E = 1CT4  > L.  and 

<,  1,  k is  14. 


We  note  that  this  procedure  readily  generalizes  to  handle  addends 
in  the  objective  function.  In  the  next  section  we  develop  a more  direct 
procedure  that  exploits  the  structure  of  the  problem  further. 

3.3  Newton's  Method:  a Dual  Approach 

For  convenience  we  restate  the  problem  we  study: 
min  z 

s.t.  d(Xj,v^)  <_  z/w-jj  for  w^  >0;  l<_i<_m;  1 .<  j <_  n5 

d(Xj,xk)  <_  r jk>  1 < j < k < n. 

Note  that  the  upper  bounds  on  the  first  line  are  linear  functions 
of  z,  whereas  the  other  upper  bounds  are  constant.  Recall  that  the 
separation  conditions  state  that  a set  of  distance  constraints  is 

consistent  if  and  only  if  d(v.,v.)  <_  L (E.,E.)  for  all  pairs  (E.  ,E.)» 

1 j z 1 j J-  J 

where  L is  the  length  of  a shortest  path  for  a given  z,  in  the 
previously  defined  network  BC.  The  next  lemma  describes  the  length  of 
the  shortest  path. 

Lemma  3.1:  The  length  of  the  shortest  path  between  any  pair  E^j^  and 
E.  in  network  BC  is  a piecewise  linear,  concave  and  strictly  increasing 
function  of  z. 

Proof : In  the  introduction  of  this  chapter  we  saw  that  any  path 
length  can  be  expressed  as  LP(E^,Ej)  = zW^(E^,Ej)  + Wg(E_^,Ej).  Thus  any 
path  length  is  a linear  and  strictly  increasing  function  of  z.  Since  the 
length  of  the  shortest  path  between  E^  and  E^  is  the  minimum  of  such 
functions,  it  is  a piecewise  linear,  concave  and  strictly  increasing 
function  of  z. [ ] 


Defining  z.  . = rain  { z : L (E.  ,E.)_>d(v.,v.)  : 1 <_  i < j <.  n }, 

z 1 J x J 

for  feasibilty  of  the  entire  set  of  distance  constraints  we  need  z >_  z . 

•JU 

for  all  i and  j.  Thus  z"  = max  { z_  : 1 <_  i < j <_  n } . We  next  discuss 


how 


we  can  find  z.  . for  a given  pair  (E^,E.). 


Finding  z^  is  equivalent  to  finding  the  root  of  the  function 
(L  (E.,E.)  - d(v. ,v  .)) • Since  this  function  is  also  piecewise  linear, 

Zv  1 J 1 J 

concave  and  strictly  increasing,  we  can  use  Newton's  method  to  find  its 

root.  We  first  motivate  the  procedure.  For  a given  lower  bound  on  z, 

zT  , we  find  the  shortest  path  between  nodes  E.  and  E.,  and  values  of 

W^CE-.E.)  and  W„(E.,E.)  that  define  this  shortest  path  as  follows: 

B l j L l j 

L (E.,E.)  = zWr(E.,E.)  + Wr(E.,E.).  We  then  extrapolate  this  line  and 
z 1 j LlJ  D1J 

find  a z value,  where  it  intersects  the  line  y = d(v^,Vj).  For  that 
value  of  z,  we  again  find  a shortest  path.  We  continue  the  procedure  as 
long  as  we  get  a different  shortest  path  at  each  successive  iteration. 

The  current  z value  at  the  termination  is  z^_y  now  giye  an  example. 

Note  the  W„  and  W„  terms  will  change  as  z increases.  The  superscripts  on 

D L 


the  WD  and  W„  terms  indicate  the  iteration  number. 

D L 
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y = d(vi>Vj) 


choose  some  Zq,  set  z = z^; 
find  L.(E,,E  ) = zWB°(E.,E  ) + W^CE^E  ); 

using  z1Wb°(E±,E  )•  + Wc°(EifE  ) 


z 1 
compute  z-^ 

set  z = z 


1 

find  L (E. 
z 1 

compute  z ^ 

set  z = z^ 

find  L (E. 
z x 

compute  z^ 
set  z = z„ 


find  L (E. 
z 1 

compute  z^ 


d(vi,vj.) ; 


E ) = zw\E  E.)  + W X(E.  ,E .) ; 

J ts  i j L l j 

using  z2WB1(Ei>E  ) + W^CE^E  ) 


E ) = zW  2(E  E ) + W 2(E  E ); 

J B 1 J L 1 J 

using  z3WB2(Ei(Ej)  + W^CE^E.) 


E.)  = zWB3(EifE  ) + Wc3(EifE  ); 
using  z4WB3(Ei,Ej)  + W^E.^) 


d(vj,,v  .) ; 


dCv^v^)  ; 


d(vi ’ vj) ; 


4 " z3" 


stop  since  z 
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Below  is  the  formal  statement  of  Newton's  method  to  solve  this 
problem. 


Newton's  Method: 

find  a lower  bound  on  z,  denoted  by  z using  Section  3.1; 

" °i 

for  i = 1 to  m-1  do 

for  j = i+1  to  m do 


z = z 


old’ 


if  Lz^Ei,Ej)  < d(vi’vj)  then 

while  zT  4 z , , do 
L ' old 


Zold  " ZL; 


for  z = z^  find  all  shortest  paths  in  network  BC 

using  Floyd's  algorithm;  compute  W_,(E.,E.)  and 

B 1 J 

W„(E.,E.)  for  a shortest  path  between  E.  and  E.; 
C i J H i J 

ZL  = (d(vi’vj)  - Wc(E.fE  ))  / WB(E.,E  ); 


end 


end 


end 


z = zL. 


For  a given  pair  (E^,Ej)  that  has  a violated  separation  condition 

for  the  current  value  of  z,  this  procedure  gives  us  a sequence  of  z 

values  which  are  strictly  increasing  and  converge  to  z„  in  a finite 

number  of  iterations,  since  the  number  of  paths  between  E.  and  E.  is 

i J 

finite  and,  as  the  z values  increase,  each  path  will  be  considered  at 
most  once.  We  note  that  Dearing  and  Francis  (1974a)  use  a closely 
related  method  to  find  the  root  of  a similar  function  ocurring  in  a 
rectlinear  distance  minimax  location  problem. 


This  procedure  is  conceptually  simple,  fundamental,  and  direct  in 
the  sense  that  we  find  a z value  that  satifies  all  of  the  distance 
constraints.  But  there  is  a drawback.  In  the  worst  case  we  may 
conceivably  have  to  go  through  all  paths  between  E_^  and  to  find  a z 
value  that  satisfies  the  corresponding  separation  condition  (recall  that 
for  different  z values  we  can  have  different  shortest  paths). 

Before  we  proceed  with  the  next  section  we  note  that  we  can  use 
the  mechanics  stated  in  this  section  to  find  an  exact  solution  after  we 
terminate  the  line  search  procedure  with  z = zT . 

la 

3.4  Direct  Path  Algorithm 

We  define  a direct  path  between  nodes  E_  and  E in  the  network  BC 

S L 

to  be  a path  that  has  exactly  two  arcs  in  (or  that  goes  through  no 
other' E-node  than  its  source  and  sink).  Consequently,  an  indirect  path 
contains  more  than  two  arcs  of  A^,  (or  goes  through  network  C nodes  other 
than  E and  E ).  We  can  eliminate  many  paths  in  the  network  BC  from 
consideration  using  a result  that  is  stated  and  proven  by  Tansel,  Francis 
and  Lowe  (1982).  We  quote  the  result  using  our  notation. 

Lemma  3.2:  The  separation  conditions  hold  if  and  only  if  for  every 
direct  path  P(E  ,E  ) we  have  LP  (E  ,E  ) _>  d(v  ,v  ). 

The  proof  by  Tansel,  Francis  and  Lowe  uses  the  idea  that  every 
indirect  path  can  be  decomposed  into  several  direct  paths. 

This  result  enables  us  to  solve  the  problem  by  considering  only 
the  direct  paths  in  the  network  BC,  which  reduces  significantly  the 
number  of  shortest  paths  we  need  to  consider. 

We  now  present  an  algorithm  that  utilizes  the  above  result. 

Recall  the  lengths  of  the  arcs  in  Ag  are  independent  of  z.  We  first  find 


all  shortest  paths  in  the  network  B.  We  then  construct  the  network  BC' 
by  replacing  the  length  of  the  arc  (Nj,N^)  in  Ag  by  the  length  of  the 
shortest  path  between  N ^ and  in  the  network  B.  Finding  the  shortest 
path  between  and  and  computing  z^.  directly  for  all  i and  j,  yields 
the  optimal  objective  function  value.  Defining  to  be  the 

length  of  the  shortest  path  between  and  in  the  network  B,  we  have 
the  following  picture. 


We  now  define  z.  , to  be  the  z value  for  which  the  shortest  path 
ljkh 

from  E.  to  E . that  includes  the  arcs  (E. ,N,  ) and  (E  .,N,  ) is  tight. 
i j d IK  j n 

Also,  we  state  the  procedure  that  we  call  algorithm  DP  (for  Direct  Paths) 


formally. 


Algorithm  DP: 


ZL  ~ 0; 


find  WR(N,  ,N,  ) for  1 <_  k,  h <_  n using  Floyd's  algorithm; 


Bv  k’  h 
for  i = 1 to  m-1  do 

for  j = i+1  to  m do 

for  k = 1 to  n do 

for  h = 1 to  n do 


if  w..  >0  and  w .,  > 0 then 
lk  jh 

Zijkh  = [ d(Vvj}  ' WB(Nk’Nh}  ] 7 (w-ik_1  + 1); 


lk 


jh 


if  z . , > z,  then  zT  = z . , ; 

ijkh  L L ijkh’ 


endif 


end 


end 


end 


end 


z = zT 


Note  that  in  the  above  statement  of  the  algorithm  we  are  not 

finding  the  shortest  path  between  and  explicitly . We  compute 

z.  , for  every  combination  of  k and  h.  (Recall  that  we  need  to  have 
ijkh 

d(vitVj)  <_  LP(Ei,Ej)  for  every  path  P(Ei>Ej).)  This  shortcut  simplifies 
the  statement  and  the  coding  of  the  algorithm.  The  order  of  this 
procedure  is  clearly  0(n  m ) since  we  have  four  nested  loops;  the  two 
outermost  loops  are  repeated  0(m)  times  and  the  two  innermost  loops  are 
repeated  0(n)  times.  We  can  find  all  shortest  paths  in  the  network  B in 

o 2 

0(nJ)  time.  Thus,  assuming  n <_  m (which  is  a reasonable  assumption), 

3 2 2 2 2 

the  total  effort  for  algorithm  DP  is  0(n  +n  m ) = 0(n  m ). 
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Recall  that  solving  the  unconstrained  version  of  this  problem  was 
of  order  0(nni  ).  To  construct  our  problem,  0(n  ) constraints  are  added 
to  the  unconstrained  problem  and  yet  we  can  solve  the  constrained  problem 
in  0(n2m2)  effort,  assuming  n <_  m2.  Though  it  may  be  possible  to  find  a 
lower  order  algorithm,  we  believe  that  the  increase  in  the  order  when  we 
go  from  the  unconstrained  to  the  constrained  problem  is  reasonable. 

3.5  Procedure  SLP~I~ 

In  this  section,  we  discuss  SLP+,  a procedure  that  utilizes  the 
sequential  location  procedure  (SLP),  due  to  Francis,  Lowe  and  Ratliff 
(1978).  Given  a value  of  the  objective  function,  SLP  determines  whether 
there  exists  a feasible  solution  to  the  problem  or  not.  It  either 
constructs  a feasible  solution  or  determines  the  current  value  of  the 
objective  function  is  not  feasible.  We  use  SLP  to  provide  a lower  bound 
on  the  increase  in  the  objective  function  value.  We  first  state  SLP  for 
convenience  of  reference,  and  then  describe  how  it  discovers  a direct 
violated  path  in  case  the  current  solution  is  not  feasible.  We  then 
proceed  to  state  SLP+,  a basic  algorithm  that  uses  SLP  as  a subroutine  to 
solve  the  problem  we  study  in  this  chapter. 

Francis,  Lowe  and  Ratliff  (1978)  stated  several  versions  of  SLP; 
we  restate  the  version  that  employs  a string  model,  due  to  its  usefulness 
in  providing  insight.  Following  Francis,  Lowe  and  Ratliff  (p.  581)  we 
define  the  terminology.  (All  of  the  direct  quotes  on  pages  55  and  56  are 
from  the  same  reference.)  "We  may  imagine  that  the  tree  is  represented 
by  inscribing  straight  line  segments  on  a board  such  that  each  segment 
represents  an  arc.  We  fasten  strings  of  appropriate  length  to  locations 
on  the  arcs  or  at  nodes  of  the  inscribed  tree,  . . . ."  At  each  node  we 
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have  a separate  string  for  each  new  facility  to  be  located  with  respect 
to  the  existing  facility  located  at  the  node.  The  length  of  the  string 
for  a pair  of  existing  and  new  facilities  is  proportional  to  the  maximum 
allowed  distance  between  the  two  facilities.  We  pull  the  strings  along 
the  arcs  of  the  tree  in  order  to  determine  where  to  locate  a new 
facility.  "When  a string  is  engaged,  some  point  of  the  string  is 
permanently  affixed  to  the  tree  such  that  there  is  no  slack  in  the 
portion  of  the  tree  so  far  engaged.  When  the  strings  engaged  at  any 
point  are  all  pulled  tight  and  engaged  at  another  point,  we  prune  the 
strings  at  the  latter  point."  We  use  c„  and  b^k  to  denote  the  maximum 
allowable  distance  between  existing  facility  i and  new  facility  j,  and 
between  the  pair  of  new  facilities  j and  k,  respectively. 

"During  each  iteration  of  the  procedure  we  partition  the  original 
tree  into  two  subsets;  one  green,  the  other  brown.  The  green  tree  is 
always  a tree,  while  the  brown  subset  is  a forest  consisting  of  subtrees 
of  the  original  tree,  each  of  which  is  rooted  at  a node  of  the  green 
tree."  The  procedure  only  works  on  the  green  tree,  which  becomes 
smaller  as  the  process  progresses.  SLP  can  be  classified  as  an  "outside- 
in"  procedure.  We  denote  nodes  of  the  green  tree  by  u's;  a green  tree 
node  is  either  a node  of  the  original  tree  or  a new  facility  location. 

Below  we  state  a version  of  SLP  that  uses  strings  to  represent  the 
upper  bounds  on  the  distances.  We  index  the  conditional  statements  (if 
statements)  by  numbers,  and  actions  that  are  taken  by  letters.  We  later 
use  these  numbers  and  letters  in  a logic  chart  of  SLP,  and  refer  to  them. 
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SLP: 

t h 

0:  fasten  strings  of  length  . for  all  j to  |^ch  vertex  v.  (the  j 
string  is  said  to  be  associated  with  the  j new  facility); 
color  T green; 

define  {v^}  to  be  a trivial  brown  subtree  rooted  at  v^  for  each  tip  t. 

1:  while  the  current  green  tree  consists  of  more  than  a single  tip  and 
there  is  at  least  one  new  facility  to  be  located  and  no  violated  path 
has  been  found,  do: 


A:  choose  any  tip  u of  the  current  green  tree; 

denote  by  u the  adjacent  vertex  in  the  current  green  tree; 
pull  all  the  strings  at  u towards  u . 


2:  if  all  strings  engaged  at  u do  not  reach  u , then 

L b 


C:  choose  a shortest  string,  say  one  corresponding  to  the  new 
facility  j ; 

locate  x.  on  (u. ,u  ) such  that  the  shortest  string  is 
tight;  J S 

engage  and  prune  all  strings  emanating  from  u (except  the 
shortest  one)  at  x.; 

color  (ut>x.)  browrl,  adjoin  it  to  the  brown  subtree  rooted 

at  u ; x.  becomes  a tip  of  the  green  tree, 
t J 


3:  if  for  all  located  facilities  (existing  or  new)  in  the 
green  tree,  the  string  associated  with  the  facility  and 
the  recently  located  new  facility  j reaches  x.,  when 
pulled  towards  x.,  then 


D:  remove  all  such  strings; 

fasten  strings  of  length  b at  x.,  for  all  new 
facilities  k not  yet  located.  ^ 

E:  else,  a violated  path  is  discovered;  there  is  no  feasible 
solution. 


B:  else,  engage  and  prune  all  strings  at  ug; 

color  (u,_,u  ) brown, 
t s 


endwhile 

4:  if  no  violated  path  has  been  found,  then 

F:  locate  all  unlocated  facilities  at  the  single  tip; 
terminate  with  a feasible  solution. 

G:  else,  the  current  solution  is  infeasible. 
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We  note  that  for  procedure  SLP+  we  use  an  expanded  version  of  the 
original  SLP.  We  replace  the  action  G above  by  "G:  else,  construct  the 
violated  path  via  traceback.".  This  enables  us  to  calculate  the  next 
value  of  the  objective  function,  in  an  effort  to  generate  an  increasing 
sequence  of  the  objective  function  values  that  converges  to  the  optimum. 
The  traceback  feature  is  discussed  in  detail  in  Section  4.4.  We  now  give 
the  logic  chart  of  the  above  descibed  procedure,  where  "+"  stands  for 
"yes"  and  "-"  stands  for  "no". 


Note  we  always  start  at  some  tip  of  the  current  green  tree  (either 
an  existing  facility  or  a located  new  facility)  and  continue  pulling 
strings  until  we  locate  a new  facility  (or  decide  that  the  current 
solution  is  infeasible).  Hence,  until  we  terminate,  we  locate  "chains" 
of  new  facilities  within  some  brown  subtrees,  with  tight  strings  between 
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succesively  located  new  facilities.  We  call  such  a chain  a "partial 
path".  Thus  a partial  path  consists  of  a vertex  of  the  original  tree  and 
a set  of  new  facilities  located  in  a brown  subtree  with  tight  strings 
between  successively  located  new  facilities.  Note  the  distances  in  a 
partial  path  are  equal  to  the  corresponding  distancees  between  the  E-  and 
N-nodes  of  the  network  BC,  since  all  strings  along  a partial  path  are 
tight. 

Note  that  the  only  branch  in  the  above  chart  that  corresponds  to 
an  infeasible  termination  is  the  branch  E.  We  reach  this  branch  in  case 
some  string  does  not  reach  a newly  located  facility.  There  are  two  kinds 
of  strings,  the  ones  relating  existing  facilities  to  new  facilities  (EN 
strings)  and  the  ones  relating  pairs  of  new  facilities  (NN  strings). 
Suppose  the  EN  string  pq  does  not  reach.  We  then  have  a violated  path 
that  consists  of  the  partial  path  starting  at  the  newly  located  facility 
q (ending  at  some  existing  facility)  and  the  partial  path  ending  at  the 
existing  facility  p.  If  some  NN  string  qr  does  not  reach,  then  our 
violated  path  consists  of  two  partial  paths,  starting  at  the  new 
facilities  q and  r respectively  (ending  at  two  separate  existing 
facilities) . In  both  cases  the  violated  path  is  between  two  existing 
facilities  (ending  points  of  the  two  partial  paths)  and  it  contains  no 
other  existing  facilities.  Thus  it  is  a direct  path. 

In  order  to  facilitate  the  recovery  of  the  violated  path  we  keep 
track  of  why  a new  facility  was  located  (which  other  facility  caused  the 
location),  each  time  we  locate  one.  Thus,  we  can  trace  a partial  path 
back  to  the  tip  (existing  facility)  of  the  original  tree  it  originated 
from.  We  give  an  example  of  the  traceback  feature  in  Section  4.4.4. 
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Each  time  we  locate  a new  facility,  say  new  facility  k,  we  check 
all  strings  involving  new  facility  k (condition  3 in  our  chart)  by 
pulling  the  corresponding  strings  towards  the  new  facility  k.  Denote  the 
closest  point  on  the  tree  to  new  facility  k that  some  string  attached  at 
facility  j can  reach,  by  P ^ . We  use  the  term  "gap"  to  denote  the  tree 
distance  between  P.  and  the  new  facility  k.  If  the  string  reaches  the 
new  facility  k,  then  the  gap  is  zero  (there  is  no  gap);  else  the  gap  is 
positive.  A positive  gap  corresponds  to  a violated  path. 

If  the  largest  gap  is  nonpositive  (ie.  if  all  strings  reach)  then 
we  continue  with  SLP  throwing  away  all  reaching  strings  (action  D). 
Otherwise,  we  traceback  the  violated  path  that  corresponds  to  the  largest 
positive  gap.  Note  that  each  time  we  locate  a new  facility,  we  have  a 
partial  path  ending  at  that  new  facility.  In  case  one  string  does  not 
reach,  pulling  all  related  strings  towards  this  newly  located  facility 
corresponds  to  considering  all  completions  of  this  partial  path  (for 
which  we  already  have  a violation),  where  the  second  partial  path 
originates  in  some  other  brown  subtree  or  the  current  green  subtree. 

We  can  now  state  SLP+,  an  algorithm  that  uses  SLP  to  find  a 
violated  path  for  a given  value  of  z^,  if  one  exists.  A violated  path  in 
the  original  tree  corresponds  to  a violated  path  condition.  SLP+  then 
computes  the  necessary  z value  to  satisfy  the  violated  path  condition. 

The  lower  bound  on  z is  updated  using  the  current  value  of  z and  the 
procedure  terminates  when  there  are  no  violated  paths  left.  This 
procedure  is  essentially  a generalization  of  SLP.  It  uses  features  used 
in  Newton's  method  (Section  3.3)  and  the  algorithm  DP  (Section  3.4)  to 
exploit  the  problem  structure.  If  there  is  no  feasible  solution  to  the 
problem  for  a given  value  of  z,  then  we  analyze  the  new  facilities 


located  by  SLP  (traceback)  and  determine  a direct  violated  path.  Thus 
this  procedure  inherently  utilizes  Lemma  3.2.  The  lower  bound  is  updated 
in  the  exact  same  way  as  in  Newton's  method,  using  the  parameters  of  the 
shortest  path.  Below  we  state  the  procedure  SLP"*".  The  most  recently 
located  new  facility  is  denoted  by  , while  Wg  and  are  the  parameters 
describing  the  length  of  a shortest  path  as  defined  in  Section  3.1. 

SLP+: 

find  Zg  using  the  lower  bound  procedure  in  Section  3.1;  z = z^ 
while  SLP  cannot  construct  a feasible  solution  for  z 

find  the  largest  gap; 

traceback  the  corresponding  violated  path,  say  P(Eg,Et); 

- - U(vs,vt)-WB(Es,Et)]/Wc(Es,Et); 

end 

Note  SLP4"  satisfies  at  least  one  path  condition  at  every 
application;  hence  it  is  a finite  procedure.  However,  it  suffers  from  a 
drawback  similar  to  Newton's  method  (Section  3.3).  Since  the  length  of 
any  path  (between  two  E-nodes)  in  this  problem  is  a piecewise  linear  and 
concave  function  of  z,  upon  increasing  z the  shortest  path  between  two  E- 
nodes  may  change.  Consequently,  the  same  new  facility  can  be  in  some 
violated  path  for  several  iterations.  Furthermore,  SLP  does  not 
necessarily  discover  violated  paths  that  correspond  to  shortest  paths  in 
the  network  BC.  Since  SLP  stops  after  the  first  violation,  a path  it 
discovers  may  be  a shortest  path  in  a subset  of  network  BC  (at  the  time 
of  the  violation  some  new  facilities  may  not  have  been  located  yet). 

There  is  no  guarantee  that  they  will  be  shortest  paths  in  network  BC, 
unless  SLP  discovers  the  violated  path  after  having  located  all  of  the 
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new  facilities.  Although  SLP  only  discovers  direct  violated  paths,  it 
may  pick  some  paths  that  are  not  shortest  in  network  BC  and  hence  we 
cannot  use  an  argument  similar  to  the  one  used  for  the  order  analysis  of 
the  algorithm  DP.  These  factors  make  it  difficult  to  derive  a worst  case 
bound  for  the  number  of  iterations  in  SLP+. 

However,  in  contrast  to  algorithm  DP,  SLP+  spends  no  time  on  pairs 
of  E-nodes  that  do  not  yield  a violated  path;  it  only  picks  violated 
paths.  We  expect  SLP+  to  be  a computationally  efficient  algorithm.  We 
now  proceed  to  the  computational  experimentation. 

3.6  Computational  Comparison 

The  effort  needed  to  solve  our  problem  may  depend  on  many  factors, 
such  as  the  structure  of  the  tree,  the  distribution  of  the  weights,  the 
range  of  the  weights  and  the  upper  bounds,  as  well  as  m and  n,  and  the 
number  of  existing  and  new  facilities  respectively.  Since  Newton's 
Method  and  Algorithm  DP  work  on  the  network  BC  as  opposed  to  the  original 
tree,  we  doubt  that  the  structure  of  the  tree  is  a relevant  factor  in  the 
performance  of  these  algorithms.  However,  for  the  other  two  algorithms, 
which  are  based  on  SLP,  a "tip-choosing"  algorithm,  the  structure  of  the 
tree  may  affect  the  performance.  We  would  expect  these  algorithms  to  be 
more  effective  when  there  are  few  tips.  Also,  the  SLP-based  algorithms 
may  benefit  from  a nonuniform  distribution  of  the  weights.  However,  we 
believe  that  the  effect  of  the  distribution  of  weights  would  be 
relatively  small.  The  range  of  upper  bounds  on  the  distances  between  the 
new  facilities  may  be  a more  important  factor.  Tight  bounds  would  favour 
SLP  based  algorithms,  since  termination  due  to  infeasibility  would  occur 
quickly  for  small  values  of  z.  We  believe  that  the  problem  size,  m and 
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n,  is  the  most  important  parameter  affecting  the  performance  of  these 
algorithms . 

Our  basic  purpose  is  to  compare  the  different  procedures  to  solve 
this  problem  and  relate  the  computational  time  to  the  problem  size,  with 
the  size  expressed  as  a function  of  m and  n.  We  use  the  values  20,  50 
and  90  for  m,  and  5,  7 and  10  for  n.  We  solve  ten  problems  for  each 
combination  of  these  values  and  report  the  resulting  statistics  in  the 
first  part  of  our  experiment.  We  explain  the  other  parts  of  our 
experiment  later. 

All  of  the  algorithms  discussed  are  coded  in  FORTRAN  77  and  run  on 
a DEC  VAX  11/750  using  the  VAX-11  FORTRAN  V3.0  compiler.  The  codes  are 
straightforward  implementations  of  the  algorithms  and  use  no  special 
computer  science  tools  apart  from  the  canonical  form  representation  of 
the  tree  as  in  Aho,  Hopcraft  and  Ullman  (1974).  During  the  runs,  we  were 
the  only  user  of  the  system.  A memory  of  2 megabytes  is  available  to  us. 

We  compare  these  algorithms  on  the  same  sets  of  random  problems,  each  set 
consisting  of  ten  problems.  To  generate  the  problems  we  use  the  function 
RAN,  the  random  number  generator  (included  in  the  Appendix)  of  the 
system.  We  report  the  CPU  times  (excluding  the  input-output  time,  the 
time  to  generate  the  problem  and  the  compilation  of  the  output 
statistics)  in  milliseconds,  as  well  as  the  number  of  iterations  required 
by  each  algorithm.  The  time  statistics  are  collected  using  the  library 
routines  LIB$INIT_TIMER  and  LIB$STAT_TIMER.  The  CPU  times  do  not  include 
the  computation  of  the  matrix  D = (d(v^,v^))  and  the  construction  of  an 
optimal  solution  using  SLP  and  the  optimal  objective  function  value. 

However  they  do  include  the  time  for  computing  bounds  on  the  objective 
function  value,  if  the  algorithm  uses  such  bounds. 
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For  access  to  the  codes  we  use,  we  refer  the  reader  to  Appendix  B. 

For  each  code,  we  include  a listing  of  variables  and  arrays  used,  and 

comments  to  help  follow  the  logic.  For  the  line  search  method,  we  have 

two  versions  of  the  algorithm.  LINESP  uses  an  all-shortest-path 

algorithm  , whereas  LINESLP  utilizes  SLP  for  the  feasibility  test.  In 

both  versions  we  stop  with  an  uncertainty  interval  length  that  is  .01% 

of  the  value  of  the  current  upper  bound.  This  interval  length  is  a more 

consistent  stopping  criterion  than  an  absolute  final  interval  length. 

The  code  for  Newton's  method,  which  we  called  NEWTON,  uses  the  subroutine 

FLOYD  each  time  z is  updated.  The  codes  for  algorithm  DP  and  SLP+  are 

called  DP  and  SLPP  respectively.  In  all  of  these  codes,  the  only  source 

of  numerical  inaccuracy  is  the  division  that  is  performed  to  compute 

certain  z^  . values.  As  a remedy,  when  checking  the  separation 

-4 

conditions,  we  use  LP(E.,E.)  > d(v.,v.)  - 10 

i J ~ i J 

We  also  use  an  assortment  of  subroutines  with  the  main  programs 
mentioned  above.  Subroutine  TREEGEN  generates  the  random  problems  for 
the  experiment,  with  a given  set  of  parameters;  we  use  the  seed  31987. 
Subroutine  FLOYD  computes  all  shortest  paths  in  a given  network.  We  use 
it  to  compute  the  matrix  D = (d(v^,Vj))  at  the  beginning  of  each  problem; 
we  also  compute  the  shortest  path  distances  in  network  BC  with  this 
routine.  Subroutines  BOUNDL  and  BOUNDU  compute  lower  and  upper  bounds  on 
the  value  of  the  objective  function  value  of  the  problem,  as  we  described 
in  Section  3.1.  Both  of  these  routines  use  HAKSPI,  that  solves  a 1- 
center  problem  using  the  Hakimi,  Schmeichel  and  Pierce  (1978)  algorithm. 
Subroutine  NBC  constructs  the  network  NBC  for  given  weights,  bounds  and  z 
value.  We  used  two  versions  of  subroutine  SLP.  The  version  used  with 
LINESLP  only  tests  whether  there  is  a feasible  solution  for  a given  z 
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value  or  not,  whereas  the  version  used  with  SLPP  finds  a violated  path. 

The  second  version  is  more  involved  due  to  the  traceback  of  the  violated 
path.  We  discuss  this  traceback  feature  further  in  Chapter  5. 

We  now  summarize  the  memory  requirements  for  each  code.  As 
discussed  above,  for  convenience  we  created  a set  of  subroutines  and  then 
with  each  of  the  four  codes  we  used  the  necessary  subroutines  from  that 
set.  The  arrays  were  dimensioned  in  each  subroutine  separately.  The 
memory  requirements  listed  below  can  be  decreased  substantially  by 
combining  a main  program  and  its  subroutines  into  a single  code.  We  list 
the  actual  size  of  the  memory  used  by  our  programs  in  terms  of  m,  the 
number  of  existing  facilities  and  n,  the  number  of  new  facilities.  We 
exclude  the  arrays  used  by  the  tree  generator  and  the  statistics 
subroutines. 

Table  3.1:  The  memory  requirements  for  each  of  the  four  codes,  in  terms 

of  the  problem  size,  m and  n. 

Code  Memory  locations  used 


SLPP 

2 2 
7m  +5mn+4n  +6m+7n 

LINESLP 

2 2 
9m  +6mn+4n  +7m+7n 

DP 

2 2 
3m  +mn+n  +3m 

NEWTON 

2 2 
9m  +3mn+2n  +m 

The  tree  generator  constructs  vertices  of  degree  1 to  5.  The 
generation  probabilities  of  a degree  are  .10,  .30,  .30,  .20  and  .10  for  a 
degree  of  1,  2,  3,  4,  and  5 respectively.  The  degree  of  a vertex  is 
generated  at  the  same  time  as  the  vertex  is  constructed.  However,  when 
the  total  number  of  existing  facilities  is  reached,  we  stop  the 
construction  of  vertices.  Thus  in  the  generated  tree  subtantially  more 
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than  10%  of  the  vertices  are  tips,  since  the  "last"  vertices  generated 
tend  to  be  tips.  The  weight  matrix  is  somewhat  sparse;  only  50%  of  the 
weights  are  nonzero.  (To  assure  a connected  network  NBC  we  use  a weight 
of  .01  instead  of  a zero  weight.) 


We  experienced  difficulties  in  generating  problems  for  which  the 
initial  upper  and  lower  bounds  on  the  objective  function  value  were  not 
too  close.  In  generating  w for  a fixed  j we  first  sampled  from  the 
same  distribution  for  each  existing  facility.  In  many  instances  this 
resulted  in  trivial  problems  where  the  lower  bound  was  equal  to  the  upper 
bound.  Since  we  do  not  believe  that  such  problems  would  be  too  useful  in 
testing  the  performance  of  an  algorithm,  we  use  the  following  "zoning" 
idea  to  generate  the  weights.  We  assume  that  for  each  new  facility, 
there  exists  a zone  (a  subtree  of  the  original  tree)  in  which  the  demand 
for  that  new  facility  is  considerably  higher  than  elsewhere  on  the  tree. 
The  nonzero  weights  within  the  zone  of,  say,  new  facility  j were 
integers,  exponentially  distributed  with  a mean  Vj_n(j)»  which  in  turn  is 
a uniform  integer  random  number  between  10  and  50.  (For  each  new 
facility,  the  y^n(j)  is  different.  This  simulates  the  effect  of  varying 
importance  of  new  facilities.)  Outside  the  zone,  the  weights 
corresponding  to  new  facility  j were  again  exponentially  distributed  with 
a mean  |x  t ( j ) » which  in  turn  is  a uniform  integer  random  number  between 
1 and  5.  The  primary  purpose  of  this  zoning  idea  was  to  generate 
nontrivial  problems,  but  we  believe  that  in  some  instances  it  may  result 
in  a reasonable  model.  (We  can  imagine  a city  with  several  ambulance 
companies,  where  each  company  predominantly  serves  (but  is  not  limited 
to)  a certain  region.)  Below  we  indicate  for  an  example  with  20  existing 
and  5 new  facilities,  the  effect  of  our  "zoning".  This  also  is  the  tree 
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generated  for  the  first  problem,  by  our  generator  TREEGEN.  We  indicate 
the  zones  with  dotted- circles. 


The  arc  lengths  are  also  integers,  uniformly  distributed  between  1 
and  10.  The  upper  bounds  on  the  distances  between  the  new  facilities  are 
uniformly  distributed  integers.  For  n values  of  5 and  7 we  used  the 
range  (5,10).  For  n = 10,  we  used  ranges  of  (3,8),  (5,12)  and  (3,10) 
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for  m values  of  20,  50  and  90  respectively.  In  determining  these  ranges 

we  tried  to  avoid  optimal  objective  function  values  that  are  very  close 

to  the  upper  or  lower  bounds  on  the  objective  function.  In  all  of  our 

problem  sets  in  the  first  part  of  the  experiment,  z'  is  near  the  midpoint 

between  the  initial  bounds,  zT  and  z ; the  maximum  distance  between  the 

Lj  u 

midpoint  and  tT  is  15%  of  the  distance  between  the  initial  bounds. 

The  remaining  parts  of  our  experiment  use  SLP+  exclusively,  which 
was  by  far  the  most  effective  algorithm  in  the  first  part  of  the 
experiment.  In  the  second  part  of  our  experiment,  we  use  a set  of  five 
problems  with  90  existing  and  10  new  facilities.  For  the  first  run,  the 
upper  bounds  are  generated  uniformly  between  2 and  12  and  the  sparsity  of 
the  weight  matrix  is  50%.  Then  we  test  the  effect  of  the  sparsity  of  the 
weight  matrix  on  SLP+,  keeping  the  range  on  the  bounds  the  same.  We 
.first  change  the  percentage  of  nonzero  weights  to  80%  and  then  to  20%. 

In  an  effort  to  test  the  effect  of  the  "tightness"  of  the  distance 
constraints,  we  try  ranges  of  (2,22)  and  (2,3)  on  the  problem  set  with  a 
weight-matrix  sparsity  of  50%.  We  report  the  statistics  for  all  these 
runs  and  test  the  hypotheses  that  the  CPU  times  for  SLP+  are  sensitive  to 
the  sparsity  of  the  weight  matrix  and  the  tightness  of  the  distance 
constraints . 

In  the  third  part  of  our  experiment,  we  use  two  sets  of  larger 
problems.  The  first  set  consists  of  problems  with  200  existing  and  50 
new  facilities,  whereas  in  the  second  set  we  have  problems  with  300 
existing  and  75  new  facilities.  The  objective  of  this  part  is  to  see  how 
well  SLPP  performs  on  larger  problems.  We  also  study  the  effect  of  the 
lower  bound  on  the  performance  of  SLPP. 
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Below  are  the  results  of  the  experiment  and  our  comments.  On  the 
first  set  of  problems  with  m = 20  and  n = 5 LINESP,  the  bisection  search 
code,  utilizing  Floyd's  algorithm  to  check  for  feasibility,  is  an  order 
of  magnitude  slower  than  LINESLP,  which  uses  SLP  for  the  same  purpose. 

(In  miliseconds,  the  average  CPU  times  are  385  and  4922  for  LINESLP  and 
LINESP  respectively.)  Thus  we  decide  to  exclude  LINESP  from  further 
testing.  This  was  also  an  indication  that  the  SLP  based  algorithms, 
bisection  search  and  SLP+,  would  be  computationally  more  efficient  than 
the  shortest  path  based  procedures,  Newton's  method  and  algorithm  DP. 

We  compute  the  sample  average,  the  sample  standard  deviation,  and 
the  maximum  and  the  minimum  of  the  CPU  times  for  each  of  the  four  codes 
we  tested,  on  each  problem  set.  We  also  compute  the  above  statistics  for 
the  number  of  iterations  needed  by  each  code.  Below  is  a table  of  sample 
average  CPU  times  in  miliseconds,  rounded  to  the  closest  integer.  The 
sample  standard  deviations  are  indicated  next  to  the  average  times,  in 
parantheses.  We  list  the  statistics  in  the  order  SLPP,  LINESLP,  DP  and 
NEWTON. 


Table  3.2:  Run  time  (in  milliseconds)  sample  averages  and  sample  standard 
deviations  for  the  codes  tested,  for  a sample  of  10  problems  per 
set . 


m 20 

50 

90 

Code 

n 

125 

( 15) 

571  ( 27) 

1655  (119) 

SLPP 

5 

385 

( 27) 

1296  (281) 

3768  (783) 

LINESLP' 

318 

( 4) 

1997  ( 5) 

6526  ( 7) 

DP 

1107 

(390) 

10858  (5457) 

54974  (35783) 

NEWTON 

169 

( 23) 

796  ( 73) 

2362  (259) 

7 

466 

( 48) 

1758  ( 88) 

4768  (279) 

!» 

594 

( 5) 

3765  ( 5) 

12309  ( 6) 

1809 

(583) 

16441  (6135) 

— 

238 

( 24) 

1129  (107) 

3330  (250) 

10 

685 

(109) 

2289  (183) 

5939  (208) 

Tf 

1184 

( 5) 

7498  ( 4) 

24400  ( 9) 

2511 

(816) 

21810  (9200) 

— 

We  do  not  test  NEOTON  for  m = 90  and  n = 7,  10  due  to  its 
relatively  slow  performance  in  other  sets.  The  next  table  shows  the 
sample  averages  and  sample  standard  deviations  of  the  number  of 
iterations  for  each  algorithm.  For  LINESLP,  one  iteration  consists  of  an 
attempt  to  locate  all  new  facilities  using  SLP  and  a z update,  whereas 
for  SLP+  we  also  trace  back  a violated  path  that  is  detected  by  SLP. 

Thus,  an  SLP+  iteration  takes  more  time  than  a LINESLP  iteration.  For 
NEWTON,  each  iteration  consists  of  computation  of  the  new  z value  by 
finding  the  slope  and  the  intercept  of  the  current  violated  shortest  path 
function,  via  traceback  and  a call  to  FLOYD  to  compute  all  shortest  paths 
for  the  new  value  of  z.  For  DP,  once  all  shortest  paths  in  network  B are 
found,  we  always  go  through  n m(m-l)/2  checks.  Thus  we  do  not  list  the 
iteration  statistics  for  DP.  The  statistics  are  listed  in  the  order 


SLPP,  LINESLP  and  NEWTON. 


Table  3.3  : Sample  averages  and  sample  standard  deviations  of  the  number 
of  the  iterations  by  SLPP,  LINESLP  and  NEWTON. 


20 

50 

90 

Codes 

2.4  ( .7) 

2.3  ( .7) 

1.8  ( .9) 

SLPP 

13.6  ( .5) 

11.6  (4.1) 

11.4  (4.2) 

LINESLP 

1.9  (1.1) 

1.8  (1.5) 

1.8  (1.9) 

NEWTON 

2.7  ( .8) 

2.8  ( .9) 

2.8  (1.2) 

13.5  ( .5) 

13.3  ( .7) 

13.0  ( .5) 

TT 

2.8  (1.3) 

2.8  (1.5) 

— 

2.6  ( .7) 

3.3  (1.6) 

3.3  (1.3) 

13.3  ( .7) 

13.8  ( .4) 

13.2  ( .4) 

ft 

2.8  (1.3) 

3.3  (1.9) 

— 

Before  we  compare  these  codes  we  first  comment  on  the  behaviour  of 
each  code  separately.  We  note  that  the  statistics  of  the  problem  set 
with  m = 90  and  n = 5 are  somewhat  deceptive,  because  that  specific  set 
includes  four  problems  for  which  the  distance  constraints  are  redundant. 
Other  problem  sets  include  zero  to  two  such  problems.  Every  remark  and 
conclusion  we  make  is,  of  course,  based  on  our  experimentation. 

With  a maximum  CPU  time  of  3.86  seconds,  SLPP  is  very  fast,  even 
for  the  larger  problems  of  this  part.  Although  we  tried  to  generate 
"hard"  problems,  as  we  described  earlier,  SLPP  used  at  most  six 
iterations.  One  problem  with  90  existing  and  10  new  facilities  took  6 
iterations,  but  required  only  16%  more  time  than  the  average  time  of  the 
problems  in  its  set.  Furthermore,  it  required  only  24%  more  time  than 
another  problem  of  the  same  set  which  was  solved  in  2 iterations.  This 
indicates  that  the  CPU  time  is  not  very  sensitive  to  the  number  of 
iterations.  The  main  reason  for  that  is  that  the  early  iterations  of  a 
problem  are  executed  very  quickly  and  the  last  few  iterations  take  most 
of  the  time.  (Recall  that  the  subroutine  SLP  is  only  executed  until  a 
violated  path  is  detected.)  Thus  the  total  time  for  the  problem  is 
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dominated  by  the  last  few  iterations.  The  number  of  iterations  increases 
only  moderately  with  increasing  problem  size.  Note  that  the  difference 
between  the  average  number  of  iterations  of  our  smallest  sized  and 
largest  sized  problem  sets  is  less  than  one.  Furthermore,  the  maximum 
number  of  iterations  for  the  smallest  sized  set  was  4,  whereas  the 
minimum  number  of  iterations  for  the  largest  sized  set  was  2.  We 
conclude  that  SLPP  is  a consistent  and  effective  algorithm. 

With  a maximum  CPU  time  of  6.23  seconds,  LINESLP  is  a reasonably 
fast  algorithm.  The  number  of  iterations  required  to  bring  the  length  of 
the  uncertainty  interval  down  to  .01%  of  the  current  upper  bound  was 
almost  the  same,  regardless  of  the  problem  size.  We  can  detect  no 
pattern  in  the  number  of  iterations,  depending  on  the  problem  size; 
furthermore  the  average  numbers  of  iterations  are  13.6  and  13.2  for  our 
smallest  sized  and  largest  sized  problem  sets  respectively.  (The  reason 
for  the  low  average  numbers  of  iterations  and  unusually  high  standard 
deviations  in  sets  with  n = 5 and  m=  50  and  90  is  that  these  sets  each 
contain  a problem  for  which  the  initial  lower  bound  is  equal  to  the 
initial  upper  bound.  This  causes  the  procedure  to  terminate  with  zero 
iterations.)  The  following  is  an  explanation  for  this  (lack  of)  pattern. 
Since  we  generate  the  weights  and  the  distances  of  the  problems  with  the 
same  parameters  and  distributions  (for  all  sets),  the  lengths  of  the 
initial  uncertainty  intervals  are  not  extremely  different  from  one 
another.  (Earlier,  we  discussed  the  dependence  of  the  number  of 
iterations  on  the  initial  bounds  and  the  acceptable  length  of  the 
uncertainty  interval.)  Since  the  numbers  of  iterations  needed  for  the 
sets  were  very  close  to  one  another,  we  conclude  that  the  performance  of 
this  code  should  be  dominated  by  the  SLP  subroutine  used.  Hence  the  CPU 
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time  should  be  a function  of  mn  + n(n-l),  which  is  the  complexity  of  SLP , 
with  a startup  time  needed  to  compute  the  bounds. 

The  most  striking  fact  about  the  statistics  of  algorithm  DP  is 

their  robustness.  Note  that  the  sample  standard  deviations  of  CPU  times 

are  between  4 and  9 miliseconds  for  all  of  the  sets.  In  our  largest 

sized  problem  set,  the  difference  between  the  fastest  and  the  slowest 

problem  is  30  miliseconds,  or  .0012%  of  the  average  for  that  set. 

However,  this  should  be  expected.  As  we  stated  earlier,  after  finding 

all  shortest  paths  in  network  B,  this  algorithm  goes  through  exactly 

n2m(m-l)/2  simple  arithmetic  operations  (calculation  of  zijkh  through  one 

subtraction  and  one  division)  and  comparisons  (comparison  of  z_^k  with 

the  current  lower  bound  on  z).  Since  there  is  no  startup  time  needed  for 

this  algorithm,  the  CPU  time  needed  can  be-  estimated  using  the  order  of 

3 2 

the  algorithm,  which  is  0(n  + n m(m-l)/2).  We  believe  that  most  of  the 

computational  time  is  spent  finding  shortest  paths  in  network  B,  since 
the  rest  is  merely  a sequence  of  simple  arithmetic  operations  and 
comparisons.  The  maximum  time  needed  for  one  problem  using  this 
algorithm  is  24.4  seconds. 

We  do  not  use  NEWTON  for  m = 90  and  n = 7,10  since  for  m = 90  and 
n = 5 it  produced  running  times  of  up  to  116.14  seconds.  The  sample 
standard  deviations  of  CPU  times  are  quite  high.  A closer  look  indicates 
that  the  computation  times  depend  very  heavily  on  the  number  of 
iterations.  Recalling  that  each  iteration  means  a call  of  subroutine 
FLOYD  and  computation  of  all  of  the  shortest  paths  in  network  B provides 
an  explanation.  In  the  largest  sized  problem  set  we  tested  this  code  on, 
we  have  computation  times  of  20.67,  39.65,  58.79,  77.90,  96.99,  and 
116.14  for  five  different  problems,  requiring  0,  1,  2,  3,  4 and  5 
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iterations  respectively.  Note  that  the  difference  between  two 
consecutive  times  in  the  above  sequence  is  19.09  +_  .1  seconds.  This 
difference  is  the  time  needed  for  FLOYD  and  for  the  computation  of  the 
slope  and  intercept  of  one  shortest  path  function  (which  corresponds  to  a 
violated  path).  The  time  that  is  necessary  to  compute  a lower  bound  and 
to  check  the  separation  conditions  for  all  pairs  is  about  20  seconds,  the 
time  used  by  the  problem  with  0 iterations.  Even  though  it  produces  high 
computation  times,  in  the  70  problems  NEWTON  solves,  it  never  has  to  do 
two  iterations  for  the  same  pair  of  existing  facilities  (recall  the 
figure  in  Section  3.3).  To  satisfy  a violated  separation  condition  for  a 
pair  of  existing  facilities,  NEWTON  has  to  go  through  only  one  z update 
in  each  of  the  problems.  Thus  the  experimentation  does  not  support  our 
speculation  that  this  procedure  may  go  through  all  possible  shortest 
paths  for  a given  pair  of  existing  facilities. 

We  now  proceed  to  the  comparison  of  the  performance  of  our  codes. 
The  ranking  of  the  sample  averages  of  the  CPU  times  is  the  same  for  all 
problem  sizes,  with  the  only  exception  at  the  set  with  (m,n)  = (20,5), 
where  algorithm  DP  is  faster  than  LINESLP.  Since  NEWTON  and  SLPP  both 
operate  on  the  principle  of  finding  a violated  path  and  (via  a traceback) 
computing  a z value  that  "fixes"  that  path,  we  compare  these  two  methods 
first.  The  average  numbers  of  iterations  for  NEWTON  and  SLP  were  very 
close;  exactly  the  same  in  many  instances.  Thus  the  wide  gap  between  the 
average  times  must  be  due  to  the  amount  of  time  needed  to  accomplish  one 
iteration.  This  phenomenon  is  similar  to  the  one  we  encountered  in  an 
early  comparison  of  LINESLP  with  LINESP.  SLP  is  much  faster  than  an  all 
purpose  all-shortest-paths  algorithm.  Another  important  difference 
between  the  two  methods  is  that  NEWTON  uses  almost  the  same  amount  of 
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time  per  iteration  and  hence  is  very  sensitive  to  the  number  of  the 
iterations  needed  to  solve  the  problem;  SLPP  takes  significantly  less 
amounts  of  time  for  earlier  iterations.  Thus,  as  the  number  of 
iterations  increases,  the  gap  between  the  computational  times  for  these 
two  methods  widens.  (For  problem  number  8 in  the  set  with  m = 90  and 
n = 5,  which  required  4 iterations  with  both  algorithms,  the  times  were 
96.99  and  1.89  seconds  for  NEWTON  and  SLPP  respectively.)  Using  a more 
efficient  all-shortest-paths  algorithm,  we  may  be  able  to  cut  down  on  the 
times  for  NEWTON,  but  with  run  times  of  almost  two  orders  of  magnitude 
higher  than  SLPP,  NEWTON  does  not  appear  promising.  We  expected  NEWTON 
to  perform  worse  than  the  SLP  based  algorithms  at  the  beginning  of  our 
test.  Also,  algorithm  DP  utilizes  more  information  (Lemma  3.2)  and  is 
essentially  more  refined  than  NEWTON.  We  expected  DP  to  perform  better 
than  NEWTON.  Thus  it  really  is  no  surprise  that  NEWTON  produced  the 
worst  computation  times,  although  the  growth  of  the  times  with  the 
problem  size  is  somewhat  surprising.  For  n = 5,  when  we  go  from  m = 20 
to  m = 50,  the  times  for  all  other  methods  go  up  by  a factor  of  4 to  6 
whereas  NEWTON's  times  go  up  almost  by  a factor  of  10. 

Algorithm  DP  seemed  promising  prior  to  testing.  It  has  a low 
worst  case  order  and  the  lowest  memory  requirements.  It  also  is  the 
simplest  of  the  four  algorithms  to  code;  a very  straightforward  procedure 
that  was  expected  to  be  fast.  Its  predicted  robustness,  usually  a plus 
for  an  algorithm,  turns  out  to  be  in  fact  a disadvantage.  It  has  to  go 
through  all  pairs  of  existing  facilities,  regardless  of  when  the  optimal 
solution  was  computed,  to  verify  optimality.  Even  though  the  maximum  CPU 
time  for  this  algorithm  in  our  test  is  only  24.4  seconds,  the  growth  of 
the  CPU  times  with  the  size  of  the  problem  is  not  promising.  Below  we 


show  this  growth  information  for  SLPP,  LINESLP  and  DP.  The  numbers  in 
the  tables  are  ratios  of  average  computation  times  of  two  sets  with 
either  m or  n fixed  and  the  other  one  varying.  Note  that  the  ratios  for 
algorithm  DP  are  consistently  higher  than  the  ratios  for  the  other  two 
procedures.  This  is  an  indication  that  for  larger  problems  the 
difference  between  DP  and  the  other  two  algorithms  will  grow  larger  and 
larger. 


Table  3.4: 

Ratios  of 

sample  averages  of  CPU  times 

for  two  consecutive 

values 

of  m,  with  a fixed  n. 

(Growth  rate  of 

the  times  as  m 

grows. 

) 

m 

20/50 

50/90 

4.51 

2.89 

SLPP 

n = 5 

3.37 

2.90 

LINESLP 

6.28 

3.27 

DP 

4.70 

2.97 

n = 7 

3.77 

2.71 

U 

6.33 

3.27 

4.74 

2.94 

n = 10 

3.34 

2.59 

tt 

6.33 

3.25 

Table  3.5: 

Ratios  of  sample  averages  of  CPU  times 

> for  two  consecutive 

values 

of 

n,  with  a 

fixed  m. 

(Growth  rate  of 

the  times  as  n grows 

m 

20 

50 

90 

n 

1.35 

1.39 

1.43 

SLPP 

5/7 

1.21 

1.36 

1.27 

LINESLP 

1.86 

1.89 

1.88 

DP 

1.41 

1.42 

1.41 

7/10 

1.47 

1.30 

1.25 

Tt 

1.99 

1.99 

1.98 

This  brings  us  to  the  comparison  of  SLPP  and  LINESLP,  the  two  SLP- 
based  procedures,  which  outperformed  all  the  other  procedures  we  tested. 
Note  that  at  each  iteration  both  of  these  procedures  use  SLP  to  try  to 
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locate  the  new  facilities  for  a given  value  of  z.  Since  SLPP  goes 
through  a sequence  of  infeasible  z values  until  it  finds  the  optimum,  in 
all  iterations  but  the  last  one  the  application  of  SLP  is  terminated 
before  all  new  facilities  are  located.  We  would  expect  such  applications 
of  SLP  to  take  less  time  than  applications  with  a feasible  z,  where  SLP 
is  not  terminated  before  all  new  facilities  are  located,  which  is 
sometimes  the  case  with  LINESLP.  However,  even  though  LINESLP  performs  4 
to  5 times  as  many  iterations  as  SLPP,  it  only  uses  2 to  3 times  as  much 
CPU  time.  The  basic  reason  for  this  is  the  traceback  that  is  used  in 
SLPP  to  compute  the  next  value  of  z. 

In  Table  3.2,  we  can  see  that  CPU  times  for  SLPP  dominate  the  times 
for  LINESLP  consistently.  However,  Tables  3.4  and  3.5  indicate  that 
(with  the  exception  of  two  entries)  the . growth  ratios  for  LINESLP  are 
consistently  smaller  than  the  growth  ratios  for  SLPP.  Thus,  as  the 
problem  size  grows,  the  ratio  of  the  CPU  time  for  LINESLP  to  the  CPU  time 
for  SLPP  gets  smaller.  Below  we  provide  this  ratio  information. 

Table  3.6:  Ratio  of  the  CPU  time  for  LINESLP  to  the  CPU  time  for  SLPP. 


n 

m 20 

50 

90 

5 

3.08 

2.27 

2.27 

7 

2.75 

2.20 

2.01 

10 

2.88 

2.03 

1.78 

The  basic  reason  for  this  effect  of  decreasing  ratios  with 
increasing  problem  size  is  that  the  number  of  iterations  of  SLPP  grows 
(slowly)  as  the  problem  size  grows,  whereas  the  number  of  iterations  for 
SLP  is  virtually  the  same  for  all  problem  sets.  Note  that  for  a fixed 
value  of  E,  the  number  of  iterations  for  LINESLP  does  not  depend  on  the 
problem  size,  as  we  discussed  in  Section  3.2.  However,  SLPP  seems  to  go 
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through  a slightly  higher  number  of  iterations  with  increasing  problem 
size,  as  indicated  in  Table  3.3.  This  evidence  suggests  that  for  a large 
enough  problem  size,  LINESLP  may  solve  the  problem  in  less  CPU  time  than 
SLPP. 

However,  we  should  not  forget  the  accuracy  difference  between  the 
two  codes.  Recall  that  we  treated  numbers  smaller  than  10-^  as  zero  in 
SLPP  to  compensate  for  numerical  inaccuracy,  due  to  roundoff.  Thus,  we 
can  identify  SLPP  to  be  a code  that  gives  us  a final  z value  that  is 

possibly  10  ^ larger  than  the  real  objective  function  value.  (Note  that 

—8 

we  can  decrease  this  inaccuracy  to  10  with  no  extra  effort,  using 
single  precision.)  For  LINESLP,  we  used  a final  uncertainty  interval 
length  of  .01%  of  the  current  upper  bound  on  z and  approximated  the 
optimum  by  the  final  upper  bound.  For  a typical  optimal  objective 
function  value  of  1,000  to  2,000,  this  corresponds  to  a final  interval 
length  of  .1  to  .2.  In  order  to  decrease  this  value  to  10~\  the 
accuracy  we  can  get  with  SLPP,  we  need  about  10-12  more  iterations, 
almost  twice  as  many  as  were  performed  in  our  experimentation.  We  expect 
this  additional  work  to  double  the  CPU  times  for  LINESLP.  Thus,  to 
experience  the  crossover  of  the  CPU  times  for  these  two  procedures  at  the 
same  level  of  accuracy,  we  may  have  to  solve  very  large  problems. 

Since  the  closest  CPU  times  among  the  algorithms  were  produced  by 
LINESLP  and  SLPP,  we  would  like  to  know  whether  the  average  CPU  times  are 
statistically  significantly  different  or  not,  using  hypothesis  tests. 
Denoting  the  sample  size  by  p,  the  sample  averages  by  a^  and  a^,  the 
population  averages  by  and  the  sample  standard  deviations  by  s, 

and  and  the  population  standard  deviations  by  cr^  and  for  LINESLP 
and  SLP  respectively,  we  start  our  testing.  To  use  the  following  tests, 


we  assume  that  both  samples  are  drawn  randomly,  and  both  populations  are 
distributed  normally.  First  we  would  like  to  test  whether  one  mean  is 
significantly  larger  than  the  other  one,  based  on  the  sample  averages. 

We  use  the  problem  set  with  90  existing  and  10  new  facilities  in  this 
test.  Following  Guenther  (1965),  we  first  test  whether  the  variances  are 
equal  or  not,  in  order  to  determine  which  test  to  use  with  the  means.  We 
set  up  our  test  as  follows: 

H0  : aj  = a2 

H1  : °1  ^ a2 

We  use  the  test  F . . = s2/si?; 

p-l,p-l  T 2’ 

F9  9 = 2082/2502  = .692. 

Pr(.248  <_  ?9  9 <_  4.03)  = .95.  (.248  and  4.03  from  an  F-table) 

Thus,  at  95%  confidence  level,  we  cannot  reject  Hq,  hence  we'  use 
the  following  test  for  the  means: 

Hq  : < h2 

H0  : yl  > y2 

t „ = (a.-a0)/s  (2/p)^2,  where  s2  = [(k-l)s2+(k-l)s?]/k+k-2. 
p+p-2  1 2 q r q 1 2 

s2  = 9(2082+2502)/18  = 52882  and  sq  = 229.96;  hence 

tlg  = ( 5939-3330) /229.96( .447)  = 25.37. 

Pr(t18  < 3.611)  = .999 

Since  25.37  > 3.611,  we  reject  Hq  at  99.9 % confidence  level,  in 
favor  of  IL.  Thus,  we  conclude  that  there  is  enough  statistical  evidence 
to  support  our  hypothesis  that  the  population  average  of  the  CPU  times 
for  SLPP  is  significantly  less  than  its  counterpart  for  LINESLP,  for 
m = 90  and  n = 10.  We  also  remark  that  the  99.9 % intervals  around  the 
means  are  a.  .qqq^)  for  i = 1,2,  with  t18>>0005 


= 3.922.  Thus  we 
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have  the  intervals  (2349,4311)  for  SLPP  and  (5123,6755)  for  LINESLP, 
which  do  not  overlap.  The  implication  is  that  we  are  at  least  99.9% 
confident  that,  for  this  problem  size,  the  required  CPU  time  for  any 
problem  solved  using  LINESLP  will  be  higher  than  its  SLPP  counterpart. 
With  the  exception  of  the  problem  sets  with  n = 5 and  m = 50  and  90  (in 
which  the  standard  deviation  for  LINESLP  is  deceptively  high  due  to  a 
trivial  problem  in  each  set)  the  above  conclusion  can  be  drawn  for  every 
problem  set.  Thus  we  conclude  that  for  the  problem  sizes  we  use,  there 
is  very  strong  statistical  evidence  that  SLPP  is  the  faster  algorithm. 

We  now  report  the  results  of  the  second  part  of  our  testing.  In 
the  table  below,  we  indicate  for  SLPP  the  average  CPU  times  and  the 
standard  deviations  for  the  set  of  5 problems  with  m = 90  and  n = 10. 

Table  3.7:  CPU  time  statistics  for  5 problems  solved  using  SLPP  with 

(m,n)  = (90,10),  with  various  sparsities  of  the  weight  matrix  and 
tightnesses  of  the  distance  constraints. 


problem  set 

1 

2 

3 

4 

5 

% of  nonzero  weights 

50% 

80% 

20% 

50% 

50% 

range  of  dist.  constraints 

2-12 

2-12 

2-12 

2-22 

2-3 

average  CPU  time 

3258 

3234 

3204 

3142 

3308 

standard  deviation 

137 

256 

250 

208 

96 

For  the  specific  problems 

solved , 

SLPP  is 

not  sensitive  to 

the 

sparsity  of  the  weight  matrix.  It  is  only  mildly  sensitive  to  changes  in 
the  tightness  of  the  distance  constraints;  it  seems  to  use  more  time  when 
the  constraints  are  tight  and  less  time  when  they  are  loose.  In  order  to 
substantiate  these  indications,  we  use  hypothesis  tests.  We  test  problem 
sets  2,  3,  4 and  5 against  our  test  set,  namely  set  1.  Again  following 
Guenther  (1965),  we  first  test  the  equality  of  variances.  We  use  the 
problem  set  numbers  in  the  table  as  indices.  With  Hq  : > and 

Hi  : Of  i cn,  where  i = 2,  3,  4,  5,  a sample  size  of  5 for  each  set  and 
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a confidence  level  of  99%,  the  test  statistic  is  the  ratio  of  the  squared 
sample  standard  deviations.  Below,  we  provide  these  ratios. 

Table  3.8:  Ratio  of  the  squared  sample  standard  deviations  for  the 

problem  sets  1-5  solved  using  SLPP.  (The  test  statistic,  used  in 

<*l  = ct2) • 

12  3 4 

.28 

.30  1.05 

.43  1.52  1.44 

2.04  7.14  6.78  4.69 

The  null  hypothesis  is  rejected  when  the  ratio  of  the  squared 
sample  standard  deviations  is  smaller  than  .043  or  larger  than  23.2.  In 
Table  3.8,  all  of  the  entries  are  within  these  limits.  Hence  we  cannot 
reject  the  null  hypothesis  of  equal  variances  for  any  pair  of  the  problem 
sets  and  use  the  same  test  statistic  as  before. 

For  problem  set  j (j  = 2, 3, 4, 5)  our  null  hypothesis  is  that  the 
population  averages  of  the  CPU  times  are  no  different  than  the  population 
average  of  the  CPU  time  for  set  1.  We  set  up  the  following  test  for 
j = 2,  3,  4 and  5. 

H0  : yl  = yj’ 

H1  : yl  ^ yj’ 

Critical  region  : |tg|  > 4.604  for  99%  confidence, 

tg  = (ax  - a^)/sp(2/5)ly/2,  where  (sp)/'=  [ ( Sj ) 2+( s ^ ) 2 ] /2 . 

The  test  statistics  are  .185  for  j = 2 and  .424  for  j = 3.  Hence, 

for  both  j = 1 and  2,  we  cannot  reject  HQ.  Thus,  we  conclude  that  there 

is  not  enough  statistical  evidence  to  claim  that  the  CPU  times  are 
sensitive  to  the  changes  in  the  sparsity  of  the  weight  matrix. 


testing  Hq: 

2/  2 
s ,/s. 

1 i 


x 

2 

3 

4 

5 
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The  test  statistics  are  1.042  for  j = 4 and  -.669  for  j = 5 
respectively.  Thus,  we  cannot  reject  either  of  the  null  hypotheses  and 
we  conclude  that  there  is  not  enough  statistical  evidence  to  support  the 
claim  that  the  CPU  times  are  sensitive  to  changes  in  the  tightness  of  the 
distance  constraints. 

We  remark  that  the  average  number  of  iterations  for  sets  4 and  5 
are  2.2  and  3 respectively.  For  problems  with  tighter  bounds,  SLPP  goes 
through  slightly  more  iterations  to  get  to  the  optimum,  but  this  is 
compensated  for  in  that  it  takes  much  less  time  for  the  early  iterations, 
since  with  tighter  bounds  it  is  easier  to  find  a violated  path.  We  also 
note  that  we  cannot  reject  Hq  : p^  = p<-  either,  since  the  test  statistic 
turns  out  to  be  1.25.  (As  a matter  of  fact,  even  though  we  only  used  Hq 
: Pl  = Pi  for  i e (2, 3, 4, 5)  in  the  above  tests,  it  can  be  easily  verified 
that  we  cannot  reject  any  null  hypothesis  of  the  form  Hq  : p^  = p^.,  where 
i,j  (1,2, 3, 4, 5)  and  i f j based  on  our  experiment.) 

We  now  proceed  to  the  third  part  of  our  experiment.  We  test  the 
performance  of  SLPP  on  larger  problems  than  in  set  1.  In  this  part,  we 
use  mean  values  of  weights,  uniform  between  50  and  200  inside  the  zones, 
due  to  the  higher  number  of  existing  facilities.  The  weight  matrix  is 
50%  nonzero;  the  nonzero  entries  are  generated  using  exponential 
distributions.  The  upper  bounds  are  uniform  between  10  and  50.  We  solve 
a set  of  three  problems  with  200  existing  and  50  new  facilities  and 
another  set  of  three  problems  with  300  existing  and  75  new  facilities. 
Note  that  these  problems  are  an  order  of  magnitude  larger  than  the 
largest  problems  of  part  1.  For  SLPP,  the  amount  of  data  used  is 
mn+n(n-l)/2,  and  this  definitely  is  a measure  of  the  problem  size. 
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Below  we  present  the  sample  averages  for  these  two  larger  problem  sets; 
we  also  include  the  statistics  for  (m,n)  = (90,10)  for  comparison. 


Table  3.9:  SLPP  Sample  average  statistics  for  different  problem  sizes 


(m.n)  (90,10)  (200,50)  (300,75) 


problem  size  (mn+n(n-l)/2) 
average  CPU  time  (seconds) 
average  no.  of  iterations 


945  11225  25275 
3.3  82.76  360.01 
3.3  4.7  6.0 


Note  that  the  problem  sizes  for  the  (200,50)  and  the  (300,75) 
problems  are  an  order  of  magnitude  higher  than  the  problem  size  of  the 
(90,10)  problems.  However,  the  average  iteration  count  does  not  even 
double  when  we  went  from  (90,10)  to  the  larger  problems.  This  indicates 
that  the  number  of  iterations  will  not  necessarily  grow  at  the  same  rate 
as  the  problem  size. 

To  study  the  behaviour  of  the  average  CPU  times  for  our  samples, 
we  construct  the  following  table,  where  we  indicate  the  ratio  of  the 
problem  size  and  the  CPU  times  for  two  sets. 

Table  3,10:  (SLPP) Ratios  of  problem  sizes  (mn+n(n-l)/2)  and  sample 
average  CPU  times  for  three  pairs  of  problem  sets. 

(90, 10)/(200,50)  (90,10)/ (300,75)  (200,50)/(300,75) 

problem  size  ratio  11.8  26.7  2.3 

average  CPU  time  ratio  24.9  108.1  4.4 


Note  that  the  ratio  of  the  CPU  times  is  larger  than  the  ratio  of 
the  problem  sizes  for  all  of  the  pairs  above.  Hence,  the  CPU  times  grow 
faster  than  the  problem  size,  expressed  as  (mn+n(n-l)/2) . Since  the 
number  of  iterations  increase  very  slowly  as  m and  n increases,  this 
unproportional  increase  cannot  just  be  attributed  to  higher  numbers  of 


iterations . 
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We  recall  the  CPU  times  include  the  computation  of  the  lower 
bound;  and  note  to  compute  the  lower  bound  we  solve  n 1-center  problems. 
Thus  the  effort  to  construct  the  lower  bound  is  of  0(nm  ).  For  large 
values  of  n (such  as  50  and  75  in  the  two  sets  we  experimented  with),  the 
computation  of  the  lower  bound  may  take  a considerable  amount  of  time. 
Hence  we  suggest  that  part  of  this  steep  increase  in  the  CPU  times  as 
(m,n)  is  increased  is  assignable  to  the  computation  of  the  lower  bound. 
Next  we  modified  SLPP  to  start  with  a lower  bound  of  zero.  With  this 
version,  we  expected  higher  number  of  iterations;  however  a savings  in 
the  CPU  time  seemed  conceivable  due  to  reasons  stated  above.  The  average 
statistics  for  the  problem  sets  with  (m,n)  equal  to  (200,50)  and  (300,75) 
using  the  two  versions  of  SLPP  (nonzero  and  zero  lower  bounds)  are 
summarized  below. 

Table  3,11:  The  average  iteration  counts  and  CPU  times  for  SLPP,  started 

with  different  lower  bounds,  on  the  larger  problems. 


lower 

bound 

Section  3. 

1 zero 

(m,n) 

= (200,50): 

no.  of  iterations 

4.67 

10.33 

CPU  time  (seconds) 

82.76 

15.28 

(m,n) 

= (300,75): 

no.  of  iterations 

6.0 

11.0 

CPU  time  (seconds) 

360.01 

63.65 

Note  that,  as  expected,  the  use  of  zero  as  the  lower  bound 
resulted  in  a higher  number  of  iterations  than  the  version  that  was 
started  with  the  lower  bound  of  Section  3.1.  The  number  of  iterations  is 
roughly  doubled.  However,  the  CPU  times  do  go  down  quite  considerably. 
Zero  lower  bounds  resulted  in  roughly  an  80%  reduction  in  the  CPU  times. 


We  conclude  that  for  large  values  of  n (and  also  m)  we  gain  nothing  by 
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starting  SLPP  with  a "good"  lower  bound.  SLPP  finds  the  optimum  much 
faster  when  started  with  = 0. 

Note  that,  on  the  average,  the  version  of  SLPP  with  the  zero  lower 
bound  takes  slighly  more  than  1 minute  of  CPU  time  for  relatively  large 
problems,  (with  300  existing  and  75  new  facilities)  on  the  VAX  11/750. 

We  remark  that  we  also  solved  the  three  test  problems  with 
(m,n)  = (300,75)  using  LINESLP  with  an  accuracy  of  .01%  of  the  optimum, 
to  compare  the  performances  of  LINESLP  and  SLPP  on  larger  problems.  When 
started  with  the  "good"  lower  bound,  LINESLP  uses  on  the  average  424.22 
seconds,  compared  to  360  seconds  for  SLPP.  The  zero  lower  bound  also 
improved  the  times  for  LINESLP;  it  used  only  104.79  seconds  of  CPU  time 
(a  reduction  of  roughly  75%)  when  started  with  z^  = 0,  compared  to  63.65 
seconds,  fot  SLPP.  Thus,  based  on  our  problem  set  we  conclude  that  even 
problems  with  300  existing  and  75  new  facilities  are  not  large  enough  to 
demonstrate  the  conjectured  superiority  of  LINESLP  over  SLPP  for  large  m 
and  n.  At  this  point  we  are  quite  pessimistic  about  the  conjecture. 

We  now  summarize  our  conclusions  based  on  this  experiment.  SLPP 
produces  fast  CPU  times  in  absolute  terms  and  it  uses  significantly  less 
amounts  of  CPU  time  than  the  other  procedures  we  suggested.  It  is 
insensitive  to  variations  in  the  sparsity  of  the  weight  matrix  and 
variations  in  the  tightness  of  the  distance  constraints.  The  number  of 
iterations  increases  very  slowly  with  the  problem  size.  For  larger 
problems,  changing  the  lower  bound  to  zero  decreases  the  CPU  times 
considerably.  In  view  of  all  these,  we  recommend  using  SLPP  to  solve  the 
problem  of  this  chapter. 

Before  we  end  this  chapter,  we  discuss  how  the  addition  of  EN-type 
constraints  and  NN-type  objective  function  terms  affect  the  suggested 


solution  procedures.  The  line  search  procedure  and  SLP+  can  be  used  with 
no  changes,  since  these  procedures  are  based  on  SLP  and  SLP  can  handle 
these  additions  to  the  model,  if  we  define  the  lengths  of  the  strings 
attached  to  existing  facility  i by  min  { z/wih,sih  ) for  h’  and  the 
lengths  of  the  strings  attached  to  new  facility  j by  min  { z/v^.r^  } 
for  all  k.  Correspondingly,  we  need  to  redefine  the  lengths  of  arcs  in 

Ac  as  min  { z/w^.s^  )»  and  in  Ag  as  min  ( z/vjk,rjk  ^ * The  path 
lengths  are  now  piecewise  linear  and  nondecreasing  functions  of  z,  and 
thus  the  length  of  the  shortest  path  is  a concave,  piecewise  linear  and 
nondecreasing  function  of  z.  Hence,  Newton's  method  and  algorithm  SLP 
can  readily  be  generalized  to  accomodate  these  additions  to  the  model. 

The  generalization  of  the  algorithm  DP  is  more  involved  and  we  do  not 
include  it  here,  since  it  did  not  perform  as  well  as  some  of  the  other 
procedures  did  in  our  experiment. 

In  this  chapter  we  discussed  four  different  procedures  to  solve 
the  multifacility  minimax  problem  with  distance  constraints  between  new 
facilities.  All  of  our  solution  techniques  employed  the  separation 
conditions.  We  used  the  Sequential  Location  Procedure  in  the  line  search 
procedure  and  in  SLP+.  Newton's  Method  and  Algorithm  DP  use  shortest 
path  subproblems,  but  rely  on  the  Sequential  Location  Procedure  to 
construct  an  optimal  solution  after  the  optimal  objective  function  value 
is  found.  We  experimented  with  these  procedures,  and  concluded  that  SLP+ 
is  the  most  efficient  algorithm  to  solve  the  multifacility  minimax 
problem  with  distance  constraints.  We  also  discussed  how  some  of  the 
procedures  we  studied  can  accomodate  the  addition  of  EN-type  constraints 
and  NN-type  objective  function  terms. 


CHAPTER  4 

SOLVING  CONSTRAINED  TREE  NETWORK  LOCATION  PROBLEMS 
USING  LINEAR  PROGRAMMING 


In  this  chapter  we  develop  solution  methods  for  multifacility 
problems,  including  those  of  Chapters  2 and  3,  using  more  general 
techniques.  Using  a monotonicity  lemma  and  the  separation  conditions,  we 
convert  the  problem  into  an  equivalent  linear  programming  problem  and 
solve  the  dual  of  the  problem  using  the  revised  simplex  method  with 
column  generation.  The  solution  procedure  we  discuss  in  this  chapter  is 
not  limited  to  the  problems  we  considered  in  Chapters  2 and  3.  Many  other 
location  problems  can  be  approached  in  the  same  way.  We  also  remark  that 
the  objective  function  and  the  constraints  do  not  need  to  be  linear  for 
the  derivation  of  the  mathematical  programming  problem.  In  the  next 
section,  we  introduce  the  model  in  a general  form. 


4.1  The  General  Model 

As  in  the  previous  chapters,  we  denote  the  distance  between  new 

facility  j and  existing  facility  i by  d(x^,v^),  and  the  distance  between 

the  new  facilities  j and  k by  d(x.,x,  ).  Suppose  we  have  q distinct 

J k 

(q  _<  mn+n(n-l)/2)  nonnegative  distance  functions.  We  let  D(X)  denote  a 
vector  with  all  these  distance  functions  and  state  the  problem  as 
follows : 


(PG) 


min  f q(D(X) ) 

s.t.  f,  (D(X))  b,  , where  1 <.  h _<  p. 
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We  assume  each  function  fh  is  nondecreasing  in  D(X).  This 
raonotonicity  assumption  is  quite  reasonable,  since  many  location  problems 


involve  costs  which  increase  with  distance. 

We  get  the  models  of  Chapters  2 and  3 if  we  take  each  function  f 
to  be  a single  distance,  d(x  , v. ),  or  d(x.,x,)  and  likewise  take  the  fn 

J 1 J K U 

function  to  be  a summation  or  maximization  function  of  weighted 

distances.  Also,  we  take  each  term  b,  to  be  some  number,  s.  . or  r . 

h ij  jk 

Hence  the  model  we  consider  in  this  chapter  has  the  constrained 
multifacility  models  of  Chapters  2 and  3 as  special  cases.  It  is  much 
more  general,  and  many  tree  network  location  problems  can  be  put  in  the 
above  form. 

Although  many  researchers  have  studied  unconstrained  location 

problems  on  the  trees,  constrained  problems  have  received  little 

attention.  Covering  problems  (Kolen  and  Tamir  (1986))  include  covering 

location  problems,  and  a covering  problem  has  distance  constraints  of  the 

form  d(x  ,v.)  < s.  . for  a closest  new  facility  location  x.  to  v..  The  p- 
j i - ij  J i 

center  problem  on  a tree  can  be  solved  by  solving  a sequence  of  covering 
problems.  Francis  and  Lowe  (1981)  considered  a covering  problem  with 
"distinct  cover"  constraints  of  the  form  d(Xj,v_^)  <_  b_^.  Halpern  (1976, 
1978,  1980)  has  studied  the  "cent-dian"  problem,  where  a single  facility 
is  located  subject  to  upper  bounds  on  its  distance  to  existing 
facilities,  as  has  Handler  (1985).  Dearing,  Francis  and  Lowe  (1976)  have 
formulated  a number  of  problems  with  distance  constraints  and  have  proven 
that  these  are  convex  problems;  however  they  gave  no  solution  procedures. 
Francis,  Lowe  and  Ratliff  (1978)  have  studied  whether  a given  set  of 
distance  constraints  are  consistent  or  not.  Tansel,  Francis,  Lowe  and 
Chen  (1982)  studied  distance  constraints  for  the  nonlinear  p-center  and 


covering  problems  on  trees.  However,  we  know  of  no  literature  treating 
constraints  of  the  form  d(x^.,x^)  <_  r^.  These  constraints  complicate  the 
analysis  of  the  problem,  since  the  variables  are  dependent  upon  one 
another.  The  model  we  introduce  in  this  section  is  general  not  only  in 
the  sense  that  many  tree  network  location  problems  can  be  expressed  in 
that  form,  but  also  because  the  model  can  include  distance  constraints  of 

the  form  d(x  .,x,  ) < r . 

J k'  - jk 

We  mentioned  earlier  that  we  formulate  some  location  problems  as 
linear  programs  and  solve  the  dual.  There  is  also  some  network  location 
literature  on  duality.  Some  covering  problems  and  p-center  problems  can 
be  considered  to  be  primal-dual  pairs.  Halpern  (1980)  gives  some  duality 
results  for  the  "cent-dian"  model.  Tansel,  Francis,  Lowe  and  Chen  (1982) 
also  derive  some  duality  relations  for  the  p-center  problem  with  distance 
constraints.  Dearing  and  Langford  (1975)  convert  some  tree  network 
location  problems  to  equivalent  rectilinear  distance  location  problems, 
which  in  turn  can  be  solved  using  linear  programming.  The  minimax 
problems  studied  by  Dearing  and  Francis  (1979b),  Chan  and  Francis  (1976), 
Dearing  (1977),  Francis  (1977)  and  Francis,  Lowe  and  Ratliff  (1978)  all 
reduce  to  a simple  linear  programming  problem  of  minimizing  a single 
decision  variable,  say  z.  The  optimal  value  of  z is  equal  to  the  maximum 
of  a number  of  lower  bounds  on  z.  Dearing  and  Francis  (1974a)  solve  some 
minimax  multifacility  location  problems  with  rectilinear  distances.  Such 
problems  can  often  be  interpreted  as  a sequence  of  location  problems  on 
line  segments  and  have  equivalent  LP  formulations,  as  dicussed  in  Francis 
and  White  (1974). 

Due  to  the  size  of  the  linear  program  we  generate,  the  procedure 


we  suggest  is  not  competitive  with  efficient  solution  procedures  devised 


for  special  cases  of  our  model.  For  example,  as  applied  to  the  classical 
1-center  problem  with  m existing  facilities,  our  approach  yields  a linear 
program  with  m variables  and  m + m(m-l)/2  constraints.  However,  the 
Bearing,  Francis  (1974b)  approach  for  the  same  problem  yields  a trivial 
linear  program  of  minimizing  z subject  to  m(m-l)/2  lower  bound 
constraints.  The  latter  approach  exploits  the  minimax  structure  of  the 
problem,  whereas  our  approach  is  not  tailored  to  any  specific 
application.  However  our  model  provides  us  with  a unifying  collection  of 
theory  applicable  to  many  problems  that  have  been  solved  on  an  ad-hoc 
basis  in  the  past.  Furthermore  the  model  is  sufficiently  general  to 
include  as  special  cases  some  tree  network  location  problems  which  have 
never  been  studied.  The  multifacility  location  problems  with  distance 
constraints  between  pairs  of  new  facilities  constitute  only  one  such 
problem  set.  We  believe  that  this  model  will  provide  insight  into 
problems  previously  too  complicated  to  consider.  Once  such  insight  is 
obtained  we  suspect  it  will  then  be  possible  to  devise  algorithms  that 
further  exploit  the  problem  structure  for  special  cases  and  are  more 
efficient  than  the  general  solution  procedure  we  suggest. 

Tansel,  Francis  and  Lowe  (1983)  point  out  that  convexity  results 
by  Dearing,  Francis  and  Lowe  (1976)  constitute  a partial  explanation  as 
to  why  tree  network  location  problems  are  more  tractable  than  location 
problems  on  general  networks.  We  think  our  obtaining  linear  programming 
problems  for  a large  class  of  tree  network  location  problems  may  be  a 
further  explanation.  Although  our  linear  programs  are  relatively  large, 
as  we  explain  later  on,  the  basis  size  for  a given  problem  is  polynomial 
in  the  problem  parameters  m and  n. 


The  reason  we  cannot  apply  our  approach  to  general  network 
location  problems  is  that  we  use  the  separation  conditions  in  deriving 
our  mathematical  programming  model,  and  these  conditions  are  necessary 
and  sufficient  if  and  only  if  the  underlying  network  is  a tree  (Francis, 
Lowe  and  Ratliff  (1978)).  However,  for  a problem  on  a general  network 
the  mathematical  programming  problem  would  still  provide  potentially 
useful  information.  Since  on  a general  network  the  separation  conditions 
are  only  necessary  conditions  for  the  feasibility  of  the  distance 
constraints,  the  problem  would  yield  a lower  bound  on  the  optimal 
objective  function  value.  We  utilize  this  fact  in  the  next  chapter. 


4.2  Derivation  of  the  Mathematical  Programming  Problem 


In  this  section  we  define  a vector  Z = (z^,  Z2,  ...  , z^) 
that  our  problem  is  equivalent  to  the  following  problem  (PM). 
(PM)  min  fg(Z) 

s.t.  fh(Z)  <_  bh,  1 <.  h _<  p, 

D(X)  < Z, 

Z > 0. 


and  show 


Note  for  D(X)  < Z to  hold,  each  entry  of  D(X)  must  be  less  than  or 
equal  to  the  corresponding  entry  of  Z. 

Furthermore  we  derive  the  problem  (PMP)  from  problem  (PM)  by 
replacing  the  inequalities  D(X)  <Z  by  AZ  J>  d,  where  A is  an  arc-path 
incidence  matrix  with  q columns,  (later  in  this  section  we  describe  how 
the  matrix  A is  constructed)  and  d is  a vector  whose  entries  are  tree 
distances  between  existing  facilities. 
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We  state  a monotonicity  lemma  which  we  use  to  transform  (pc)  to 
(PM).  This  lemma  is  well-known.  We  include  a proof  only  in  the  interest 
of  completeness. 

Lemma  4.1:  Let  f be  a nondecreasing  function  from  into  E . 

For  any  b in  E and  D in  E + we  have  f(D)  < b if  and  only  if  there  exists 

O I 

some  Z in  E^"1"  such  that  f(Z)  <_  b and  D <_  Z. 

Proof : Suppose  f(D)  <_  b for  some  D in  E^4-  and  b in  Eg.  Defining 

Z = D we  have  D Z and  f(Z)  b.  Now  suppose  there  exists  some  Z in  Eg 

such  that  D Z and  f(Z)  b.  Since  f is  nondecreasing  we  have 
f(D)  < f (Z)  < b.[] 

Using  this  simple  but  fundamental  result  we  express  the 
constraints  f^(D(X))  _<  b^  in  the  equivalent  form  f^(Z)  _<  b^  and  D(X)  Z 
and  get  (PM). 

Francis,  Lowe  and  Ratliff  (1978)  have  established  that  the  set  of 
constraints  D(X)  Z are  equivalent  to  a collection  of  linear 
inequalities  AZ  >_  d which  are  termed  "path  inequalities".  We  use  this 
equivalence  to  derive  (PMP)  from  (PM). 

(PMP)  min  fQ(Z) 

s.t.  fh(Z)  <.  bh,  1 <.  h _<  p, 

AZ  _>  d, 

Z > 0. 

Given  an  optimal  solution  Z to  (PMP)  we  can  use  SLP  to  construct 

the  new  facility  locations  that  satisfy  D(X^)  _<  Z so  that  x"  is  a 

solution  to  (PM)  and  thus  to  (P). 

Before  we  explain  how  (PMP)  is  derived,  we  remark  that  the 

principal  limitation  of  our  approach  is  the  size  of  (PMP).  Note  that 

2 

(PMP)  has  0(mn+n  ) variables  and  p constraints  of  the  form  f,  (Z)  < b,  . 

hr  — h 


However  the  number  of  the  constraints  AZ  _>  d is  of  order  (n!mn+'*').  A 

motivation  of  this  order  is  included  in  the  Appendix.  Each  constraint  in 

the  set  AZ  >_  d corresponds  to  a path  in  an  auxiliary  network,  the  network 

BC  In  the  next  paragraph  we  describe  the  network  BC  . 
z z 

We  now  describe  how  the  inequalities  AZ  _>  d are  derived.  Let  us 

construct  an  auxiliary  network  BCz,  similar  to  the  network  BC  in  Chapter 

4,  as  follows.  Let  BCz  have  nodes  E^,  ...,  Em  corresponding  to  the 

existing  facilities,  as  well  as  the  nodes  N^,  ...,  corresponding  to 

the  new  facilities.  Include  an  arc  (E^,Nj)  corresponding  to  each 

distance  function  d(Xj,v^)  in  D(X),  the  arc  length  being  the  entry  in  Z 

corresponding  to  this  distance.  Also  include  an  arc  (N.,N,  ) 

J k 

corresponding  to  each  distance  function  d(x.,x,  ) in  D(X);  the  arc  length 

J k 

is  the  entry  in  Z that  corresponds  to  this  distance.  Let  LPz(E^,E^) 

denote  the  length  of  a simple  path  between  nodes  EL  and  E,  of  BC  . 

1 h z 

Francis,  Lowe  and  Ratliff  (1978)  have  shown  that  the  distance  constraints 
are  feasible  if  and  only  if  the  following  inequalities,  called  separation 
conditions , hold: 


LPz(Ei’Eh>  ^ d(vvh} 

for  every  path  in  BCz  between  E^  Eh>  1 <_  i < h <_  m.  Subsequently, 

Tansel,  Francis  and  Lowe  (1982)  showed  that  it  is  equivalent  to  consider 

only  separation  conditions  for  direct  paths,  namely  those  beginning  and 

ending  at  an  E-node  with  no  intermediate  E-nodes.  We  use  this  result  to 

generate  alternate  versions  of  some  of  the  methods  we  describe  in  Section 

4.4.  From  now  on  we  refer  to  a path  between  two  E-nodes  of  BC  when  we 

z 

say  "a  path"  and  to  a direct  path  between  two  E-nodes  of  BC  when  we  say 

z 

a "direct  path". 


Let  A be  a zero-one  path-arc  incidence  matrix  such  that  each  row 
of  A corresponds  to  some  path  in  BCz  and  each  column  corresponds  to  an 
arc  in  BC^.  A path  in  BCz  is  identified  by  the  ones  in  a row  of  A.  Let 
d be  a vector  with  each  entry  some  tree  distance,  say  d(v  ,v^).  For 
every  row  in  A (corresponding  to  a path  in  BCz  between  Ei  and  Eh)  we  have 

a corresponding  entry  in  d (the  tree  distance  between  v.  and  v,  ) . 

1 h 

Using  the  matrix  A and  the  vector  d defined  above,  the  necessary 
and  sufficient  conditions  for  the  feasibility  of  the  distance  constraints 
can  be  expressed  as: 

AZ  >_  d,  Z > 0. 

These  inequalities  are  called  the  path  inequalities.  Using  the 
path  inequalities  we  convert  (PM)  to  (PMP). 

We  note  when  each  function  f^,  0 <_  h <_  p,  is  linear  then  we  have  a 
linear  programming  problem,  which  has  a dual,  and  necessary  and 
sufficient  conditions  for  optimality.  In  the  next  section  we  consider 
the  linear  case,  state  the  dual  problem,  and  suggest  a procedure  to  solve 
it. 


4.3  The  Dual  Problem 

We  denote  the  version  of  (PMP)  where  each  function  f , 0 <_  h <C  p, 
is  linear,  by  (P). 

(P)  min  f^Z 

s . t . GZ  b , 

AZ  2 d, 

Z > 0, 

where  G is  a matrix  with  rows  (f^,  ...,  f ). 


This  problem  may  not  be  directly  tractable  due  to  the  large  number 


of  rows  of  A.  However,  the  number  of  columns  is  q < mn+(n-l)n/2  since 
each  column  corresponds  to  an  arc  in  network  BC^.  Hence  it  is  usually 
the  case  that  A has  many  more  rows  than  columns.  As  suggested  in  many 
linear  programming  textbooks,  such  as  in  Bazaraa  and  Jarvis  (1977),  we 
consider  the  dual  of  (P)  which  we  denote  by  (D).  Defining  the  vectors  of 
dual  variables  u^,  and  u^  we  have 


(D) 


T T T 

max  -b  u-^  + d U2  + 0 u^ 

T T T 

s.t.  -G  u^  + A u^  + I u^  = f 

Uj , U2 , u3  > 0. 


Note  that  the  problem  (D)  always  has  an  initial  basic  feasible 
solution,  where  u^  = u3  = 0,  u^  = f and  the  identity  matrix  is  an  initial 
basis  matrix. 

We  now  give  an  example  to  demonstrate  the  derivation  of  (D). 
Consider  the  1-center  problem  with  distance  constraints  and  also  an  upper 
bound  on  the  unweighted  minisum  function.  Variations  of  this  problem 
have  attracted  some  interest  in  the  past.  When  classifying  the  different 
models  that  combine  the  minisum  and  the  minimax  objectives,  Handler  and 
Mirchandani  (1979)  mention  the  general  version  of  this  problem,  where  one 
of  the  objective  functions  is  bounded  above  by  some  parameter.  Halpern 
(1976,  1978,  1980)  also  studies  alternate  models  where  he  constructs  an 
objective  function  which  consists  of  a convex  combination  of  the  two 
objectives.  Halpern' s medi-center  models  can  be  thought  of  as 
relaxations  of  problems  of  the  type  we  use  in  the  following  example, 
where  the  constraint  on  the  minisum  function  is  multiplied  by  some 
penalty  and  added  to  the  objective  function. 


• • • 9 


ra  } } 


(PG)j  min  { max  { w^d(x,v^)  : i = 1, 

s.t.  (Kx^)  <_  biS  1 <.  i <.  m, 

E { d(x,  vi)  : i = 1 , . . . , m } <_  c. 

Defining  a new  variable  y,  we  can  express  (PG)^  as  : 
min  y 

s.t.  wid(x,vi)  <_  y,  i = 1,  ...,  m, 
d(x,  vi)  <_  bi  , i = 1 , . . . , m, 

£ { d(x, v^)  : i = 1 , . . . , m } < c. 

Using  the  monotonicity  lemma  we  construct  (PM)^. 

(PM)^  min  y 

s.t.  w^z^  _<  y,  1 <.  i <.  m, 

Zi  — ^i»  1 <.  i <.  m, 

E { d(x,v  ) : i = 1,  ...,  m } < c, 

d(x,v^)  _<  z^,  1 <.  i <.  m. 

(Note  that  each  inequality  of  the  form  d(x,v^)  <_  z ^ will  hold  as 

an  equality  at  the  optimum  if  w^  > 0.) 

We  now  derive  (PMP)^  using  the  path  inequalitites . We  denote  the 

length  of  the  path  between  E.  and  E,  in  network  BC  by  LP  (E.,E,  ).  (Note 

l h zJzxh 

there  is  only  one  path  between  each  pair  of  E-nodes  for  this  1-facility 
problem.  For  the  multifacility  version  of  the  problem,  we  need  to  write 
the  path  inequalities  for  every  path  between  each  pair  of  E-nodes;  hence 
we  need  to  use  another  index.) 
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(PMP)^  min  y 

s.t.  w^z^  _<  y,  1 <_  i <_  m, 
zi  <.  bj_»  1 <.  i <.  m, 

S { : i = l , . . . , m } <_  c, 

LPz(Ei,Eh)  > d(vi,vh),  1 < i < h <_  m, 
z > 0. 


Note  that  (PMP)^  is  also  (P)p  since  the  distance  functions  are 
linear.  Consider  the  following  numerical  example. 


weights:  12  3 


4 


arc  lengths: 


2 


bT  = (2, 4, 3,5) 
c = 16 


The  corresponding  network  BCz  is 
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For  compactness,  we  substitute  z^  = y and  (P)^  follows: 


min  (0  0 

0 

0 1) 

( 

Z1 

z2  z3 

z4 

z5> 

T 

= min 

s.t. 

1 

-1 

0 

2 

-1 
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-1 
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-1 

z2 

0 
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2 
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1 
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z4 
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1 

z5 

5 

1 
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1 

16 
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1 
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1 

1 

1 
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'zl‘ 
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1 

1 

0 
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2 

Z3 
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1 
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z4 

5 
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1 
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_ Z5  _ 
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> — 
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0 

1 

0 

0 

d|0)Z  = 

1 

0 

2 

Z3 

2 

0 

1 

0 

z4 

0 

- 

zs 

- 

The  corresponding  dual  (D)^  can  be  written  as  follows: 

max  -(  0 0 0 0 2 4 3 5 16)  U]  + ( 1 3 6 2 5 3 ) u2  + 0u3 
s.t.  -GTUl  + ATu2  + u3  = ( 0 0 0 0 1)T’ 

ul»  u2’ 


u3  > ° 


Let  us  return  now  to  the  general  problem  of  interest.  Suppose  we 


*1 


have  some  arbitrary  basic  feasible  solution  u and  the  corresponding  basis 
inverse  is  B \ with  Z being  the  corresponding  set  of  simplex 
multipliers.  (Note  that  Z is  the  set  of  the  dual  variables  of  problem 
(D).)  We  have  the  following  column  vectors  of  reduced  costs 
corresponding  to  Uj,  u2  and  u^: 

- GZ  + b 
AZ  - d 

Z’ 

and  for  optimality  we  need  each  reduced  cost  to  be  nonnegative.  We  now 
consider  each  of  these  vectors  of  reduced  costs  separately. 

For  u^  the  nonnegativity  of  the  reduced  cost  corresponds  to  Z > 0. 
Thus,  if  .z±  < 0 for  some  i,  we  can  enter  the  column  e^  into  the  basis, 
where  e^  is  the  i^  unit  vector.- 

For  u-.  the  optimality  condition  is  GZ  < b.  If  G.Z  > b.,  where  G. 

1 J J J 

is  the  j*"  row  of  G and  b.  is  the  j*'*1  entry  of  b,  we  can  enter  the  column 

T 

-(G  ) . into  the  basis. 

J 

The  critical  issue  is  to  determine  how  to  do  the  pricing  for  the 
columns  corresponding  to  u2«  Note  that  each  row  of  A corresponds  to  a 
path  in  network  BC  . Since  Z is  the  vector  of  arc  lengths  in  BC  and  the 
entries  of  Z are  ordered  the  same  way  as  the  rows  of  A,  (AZ)  is  the 
vector  of  the  path  lengths  in  BCz.  Thus,  checking  for  the  nonnegativity 
of  the  reduced  costs  for  u2  is  equivalent  to  checking  the  path 
constraints . 

However,  the  path  inequalities  are  defined  for  nonnegative  arc 

lengths  in  network  BC  . Thus,  in  order  to  check  the  reduced  costs  for  u„ 

z Z 

we  need  to  have  Z _>  0.  We  shall  employ  a recommendation  of  Ford  and 
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Fulkerson  (1958)  who  encountered  a similar  situation  when  studying  a 

multicommodity  flow  problem.  Whenever  some  Z entry  is  negative  we  can 

make  the  correponding  slack  variable  basic,  continuing  to  do  so  until  we 

have  Z _>  0.  Using  an  anticycling  rule  would  guarantee  a basic  solution 

with  Z _>  0 in  finitely  many  iterations  (Dantzig,  Olden,  Wolfe  (1955)). 

We  can  check  the  reduced  cost  for  the  k^  path  by  finding  the  path 

t h 

and  computing  its  length.  Denoting  the  product  of  the  k row  of  A with 
Z by  (AZ)j^  and  the  tree  distance  between  the  E-nodes  at  the  two  ends  of 
path  k by  d^,  if  (AZ)^  - d^  < 0 then  we  can  enter  the  column  (A  )^  into 
the  basis.  To  summarize,  the  following  statement  forms  the  conceptual 
basis  of  our  approach. 

COLGEN: 

B = B = I,  Ug  = f,  u^  = 0,  U£  = 0, 
begin 


while  the  current  basic  feasible  solution  is  not  optimal,  do 


begin 

(1) 

while 

z±  < 0 for  some  i,  enter  e^  into  the  basis; 

(2) 

while 

(AZ)j^  < d^  for  some  path  corresponding  to  row  k of  A, 

T 

enter  (A  )^  into  the  basis; 

(3) 

while 

T 

G .Z  > b.  for  some  i,  enter  -(G  ) . into  the  basis; 
J J J 

end . 


The  procedure  we  suggest,  COLGEN,  is  a special  version  of  the 
revised  simplex  method  with  column  generation,  applied  to  the  dual  of  the 
problem  (P).  Column  generation  has  several  applications  in  the 
literature.  Gilmore  and  Gomory  (1961,1963)  used  this  technique 
succesfully,  to  solve  cutting  stock  problems  with  10  to  100  million 
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columns.  Lasdon  and  Mackey  (1968)  solved  multi-item  scheduling  problems 
using  column  generation.  The  widely  used  Dantzig-Wolf e decomposition 
(1960)  for  large  scale  linear  programs  is  a related  solution  technique. 
The  major  difference  between  the  two  techniques  is  that  in  Dantzig-Wolfe 
decomposition,  the  subproblems  are  small  LP  problems  (relative  to  the 
original  problem) , whereas  in  column  generation  the  subproblems  can  be 
any  type  of  optimization  problem.  The  key  to  success  in  both  techniques 
is  the  simplicity  of  the  subproblem(s) . Lasdon  (1970)  discusses  several 
examples  of  column  generation  and  gives  computational  results  in  a text 
on  optimization  for  large  scale  systems.  Bradley,  Hax  and  Magnanti 
(1977)  also  include  a brief  discussion  of  column  generation  in  their 
introductory  text  on  mathematical  programming. 

We  now  discuss  the  sequence  of  the  "while"  blocks  in  COLGEN.  As 

we  mentioned  before,  we  need  to  have  Z > 0 in  order  to  check  AZ  _>  d. 

Thus,  we  need  to  place  the  while  block  (1)  before  the  while  block  (2). 

(Note  that  Z >_  0 can  be  checked  in  0(q)  time,  since  Z has  q entries.) 

However,  the  block  (3)  can  be  placed  in  any  order  with  respect  to  the 

blocks  (1)  and  (2).  We  elect  to  insert  it  after  block  (2),  since  in 

general  it  takes  less  effort  to  detect  (AZ),  < d,  than  G.Z  > b..  We 

k k j j 

discuss  the  computational  complexities  of  the  different  procedures  to 
check  for  AZ  < d in  Section  4.4  as  we  describe  each  procedure.  However, 
we  note  here  that  the  computation  of  GZ  takes  0(pq)  effort,  since  the 
matrix  G is  p by  q.  We  also  note  that  special  structure  of  G (such  as 
G = I)  may  make  it  worthwhile  to  interchange  the  sequence  of  the  while 
blocks  (2)  and  (3).  (Please  note  that  if  the  dual  problem  (D)  is 
unbounded  (which  we  can  determine  during  the  simplex  procedure)  then  we 
know  from  the  duality  theory  that  the  primal  problem  (P)  is  infeasible.) 


We  make  the  following  observation  regarding  the  order  of  COLGEN. 

2 

We  can  update  the  basis  inverse  matrix  in  0(q  ) effort  where  q is 

2 -1 

0(mn+n  ).  The  update  of  the  dual  variables  (c^B  ) and  the  right  hand 

side  (B  ^b)  can  be  accomplished  by  attaching  these  vectors  to  the  basis 

inverse  as  a "last  row"  and  a "last  column"  respectively.  The  effort  to 

update  this  "modified"  basis  inverse  matrix  (modified  through  the 

addition  of  a column  and  a row)  is  still  0(q  ).  We  know  that  we  can 

price  the  columns  corresponding  to  u^  and  u3  in  0(q)  and  0(pq)  effort 

respectively.  In  Section  4.4  after  discussing  the  effort  needed  for 

block  (2)  of  COLGEN  (checking  for  AZ  >_  d)  we  reach  some  conclusions 

regarding  the  overall  effort  for  the  column  generation  procedure. 

Finally,  we  remark  that  COLGEN  only  outlines  the  general  ideas  of 

our  approach;  it  should  not  be  used,  in  the  above  stated  form,  to  solve 

the  problem  (D).  We  discuss  more  efficient  versions  of  COLGEN  in  Section 

4.4.  These  versions  use  various  different  methods  for  pricing  the  paths 

of  BC  . 
z 


T 

4.4  Pricing  the  Columns  of  A 

In  the  procedure  COLGEN  we  stated  in  Section  4.3,  for  Z _>  0,  we 
find  any  simple  path  k that  corresponds  to  (AZ)^  < d^.  In  this  section 
we  describe  several  procedures  that  can  be  used  to  find  such  a path.  We 
may  have  to  consider  0(n!mn"^)  simple  paths  before  we  find  such  a path  or 
decide  that  AZ  ^ d,  if  we  wanted  to  check  all  of  the  path  conditions.  We 

T 

also  discuss  alternate  procedures  for  pricing  the  columns  of  the  matrix  A 


with  less  effort. 


4.4.1  Using  Dijkstra's  Shortest  Path  Algorithm 


The  necessary  and  sufficient  conditions  for  feasibility  of  the 

distance  constraints  are  the  separation  conditions,  which  involve  lengths 

of  shortest  paths  between  nodes  pairs  of  E-nodes  in  the  network  BCz.  We 

can  use  a shortest  path  algorithm,  such  as  Dijkstra's  (1959),  to  check 

the  separation  conditions  for  each  pair  of  E-nodes.  Note  for  a given 

2 

value  of  the  vector  z,  there  are  only  0(m  ) paths  we  need  to  consider, 
namely  the  shortest  paths  between  (at  most)  all  pairs  of  the  E-nodes. 
Using  a shortest  path  algorithm  reduces  the  number  of  the  columns  to  be 
considered  enormously  and  makes  the  problem  tractable. 

We  enter  the  column  that  corresponds  to  the  first  separation 
condition  violation  found.  In  Section  4.4.2  we  discuss  a method  that 
evaluates  all  shortest  paths  before  deciding  which  column  to  enter.  The 
method  described  here  has  a different  strategy  in  that  it  enters  the 
first  column  with  a negative  reduced  cost  it  encounters,  in  an  effort  to 
prevent  unnecessary  calculations.  Please  note  although  the  first  column 
encountered  with  a negative  reduced  cost  is  entered,  this  procedure 
implicitly  prices  out  all  other  columns  that  correspond  to  (possibly 
violated)  paths  between  the  same  pair  of  the  E-nodes  as  the  selected 
shortest  path.  The  empirical  effectiveness  of  this  method  remains  to  be 
demonstrated  (Section  4.5). 

We  can  replace  the  while  block  (2)  of  COLGEN  with  the  following 


procedure: 
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for  i = 1 to  m-1 

for  h = i+1  to  m 

find  a shortest  path  between  nodes  and 
of  network  BC^  using  Dijkstra’s  algorithm; 

if  Lz('Ei,Eh^)  < d^vi’vh')  then 

T 

construct  the  column  of  A corresponding  to  the 
shortest  path  just  found;  (traceback) 
enter  the  constructed  column  into  the  basis; 
return  to  the  start  of  COLGEN; 
endif 

end 

end 

Note  the  selection  of  the  pair  of  E-nodes  can  be  accomplished  with 
two  loops  and  the  solution  on  hand  is  optimal  if  no  pair  can  be  found 
with  a violated  path. 

Labeling  the  nodes  while  growing  the  shortest  arborescence  tree 
rooted  at  E^  facilitates  the  recovery  of  the  shortest  path  and  thus  the 
construction  of  the  entering  column. 

The  following  is  another  alternative: 


select  an  E-node,  E. • 

1 ’ 

find  the  shortest  paths  between  the  node  E^  and  all  other 
E-nodes  of  network  BC ^ using  Dijkstra's  algorithm; 
gap  = min  { ^(E^E^)  - d(v..,vh)  : h = 1,  m }; 

if  gap  < 0 then 

construct  the  column  of  AT corresponding  to  the  gap  of 
shortest  path  just  found;  (traceback) 
enter  the  constructed  column  into  the  basis; 
return  to  the  start  of  COLGEN; 
endif 
repeat 

Note  this  version  does  not  enter  the  first  violated  path  found. 

It  prices  out  all  columns  that  correspond  to  shortest  paths  between  an  E- 
node  and  all  of  the  other  E-nodes.  The  additional  effort  to  find  all 
shortest  paths  between  a node  and  the  rest  of  the  network,  after  finding 
one  shortest  path,  is  minor  and  does  not  effect  the  worst— case  behaviour 
of  the  shortest  path  algorithm.  The  effort  needed  to  find  an  entering 
column  using  any  one  of  these  two  procedures  is  of  order  m(m+n)^. 
Dijkstra's  algorithm  finds  the  shortest  paths  in  network  BC  between  an 

O 

E-node  and  all  other  E-nodes  in  0(m+n)  effort,  and  the  number  of  E-nodes 
in  the  network  BC^  is  m.  Although  the  second  version  is  expected  to  take 
more  time  per  iteration,  the  benefits  from  pricing  out  more  columns  may 
result  in  fewer  iterations,  thus  improving  the  overall  performance. 

We  denote  the  two  versions  of  COLGEN  that  uses  Dijkstra's  shortest 
path  algorithm  to  find  an  entering  column  by  D1  and  D2  respectively. 


4.4.2  Using  Floyd's  Shortest  Path  Algorithm 


We  can  also  compute  all  shortest  paths  at  once  (using  an  all 
shortest  paths  algorithm  such  as  Floyd’s  (1962))  and  then  find  the  the 
path  that  corresponds  to  the  "most  violated"  separation  condition.  Among 
the  alternate  procedures  we  discuss  in  this  section,  this  one  is  the 
closest  to  the  standard  simplex.  At  each  iteration,  if  we  have 
Z _>  0,  we  enter  the  column  of  A with  the  most  negative  reduced  cost.  For 
this  version,  we  replace  the  block  (2)  in  the  procedure  COLGEN  by  the 
following: 

find  all  shortest  paths  in  network  BC  using  Floyd's  algorithm; 

amin  = 0; 

for  i = 1 to  m-1 

for  j = i+1  to  m 

if  amin  < L (E.,E.)  - d(v.,v.)  then 
z 1 j 1J 

amin  = Lz(E.,Ej)  - d(vitv.); 
r = i;  s = j; 
endif 

end 

end 

if  amin  < 0 then 

trace  the  path  between  E^  and  E^;  construct  the 
corresponding  column  and  enter  it  into  the  basis; 

else 

all  separation  conditions  are  satisfied; 


endif . 


Note  that  we  can  use  a matrix  of  pointers  to  keep  track  of  the 
shortest  paths  as  the  algorithm  constructs  them  and  thus  facilitate  the 
traceback  of  a shortest  path,  as  suggested  by  Hu  (1969).  We  call  this 
version  of  the  algorithm  F. 

We  note  that  the  computational  effort  to  execute  the  above 

3 

described  block  is  of  order  (m+n)  and  is  dictated  by  the  all-shortest 
path  algorithm  used.  Based  on  the  empirical  evidence  related  to  the  use 
of  simplex  procedure,  we  expect  that  this  pricing  technique  will  result 
(on  the  average)  in  fewer  pivots  than  the  one  in  Section  4.4.1.  However, 
the  reduction  in  the  number  of  iterations  may  not  justify  the  effort  to 
price  out  essentially  all  nonbasic  columns  corresponding  to  shortest 
paths  in  network  at  each  iteration. 

4,4.3  Using  Direct  Paths 

Tansel,  Francis  and  Lowe  (1982)  show  that  satisfying  only  a 
distinct  subset  of  separation  conditions  is  sufficient  for  feasibility. 
This  subset  is  the  set  of  the  conditions  corresponding  to  the  direct 
paths  of  the  network  BC.  Hence  we  can  further  modify  block  (2)  of  the 
column  generation  procedure  to  accomodate  this  result.  We  would  enter  a 
violated  path  only  if  it  is  a direct  path.  We  can  apply  this 
modification  to  both  of  the  pricing  techniques  discussed  in  Sections 
4.4.1  and  4.4.2.  Thus,  once  we  have  found  a violated  path,  we  would  not 
consider  it  to  be  a candidate  for  entering  unless  it  is  a direct  path. 

If  a solution  is  not  optimal  then  the  shortest  path  algorithms  we  use 
always  find  at  least  one  direct  violated  path. 

We  note  that  checking  for  a direct  path  is  quite  simple.  In  a 
direct  path,  the  number  of  (E_^,N.)  arcs  must  be  equal  to  two.  This  check 
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can  be  done  while  tracing  back  the  path  and  will  not  change  the  order  of 
the  effort  needed. 

We  point  out  that  the  number  of  direct  paths  in  the  network  BCz  is 

equal  to  ^2  Z { nP  • :j  = l,  ...,n},  where  ^2  denotes  the  number  of 

combinations  of  m elements,  taken  2 at  a time  and  P.  denotes  the  number 

n J 

of  permutations  of  n elements,  taken  j at  a time.  This  number  is  of 
order  (m^n!)  which  is  much  smaller  than  0(n!mn+'*'),  the  order  of  the  total 
number  of  paths.  (The  derivation  for  the  number  of  direct  paths  and  the 
stated  order  is  included  in  the  Appendix.)  Thus,  we  expect  this 
modification  to  result  in  more  efficient  procedures  than  the  versions 
which  do  not  utilize  the  direct  path  result.  We  call  the  codes  that  use 
direct  paths  found  using  Dijkstra's  shortest  path  algorithm  DD1  and  DD2 
and  the  code  that  uses  Floyd's  algorithm  DF. 

4.4.4  Using  the  Sequential  Location  Procedure 

Earlier  we  stated  that  SLP  either  constructs  a feasible  solution 

using  the  current  dual  variables  (string  lengths  in  network  BC)  or 

discovers  a violated  separation  condition  that  corresponds  to  a direct 

path.  We  gave  a description  of  SLP  in  Section  3.5.  In  this  section  we 

stress  the  traceback  of  a violated  path  once  one  is  found.  The  traceback 

feature  is  not  included  in  the  original  staement  of  SLP  by  Francis,  Lowe 

and  Ratliff,  since  they  used  SLP  only  to  determine  whether  a current 

solution  is  feasible  or  not.  However  we  need  to  construct  a column  for 

the  LP  model  corresponding  to  the  violated  path.  Thus,  being  able  to 

recover  the  violated  path  becomes  crucial  for  our  approach.  Traceback 

with  SLP  is  more  complicated  than  with  customary  labeling  algorithms 

because  SLP  works  with  the  tree  instead  of  the  network  BC  . 

z 
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For  traceback  purposes  we  keep  track  of  why  a new  facility  was 
located  (which  other  facility  caused  the  location) , each  time  we  locate  a 
new  facility  during  SLP.  As  we  pointed  out  in  Section  3.5,  we  also  find 
the  path  with  the  largest  amount  of  violation  from  a subset  of  all 
violated  paths,  once  we  discover  a violated  path.  We  now  give  an  example 
that  demonstrates  the  traceback  routine  and  the  path  selection 
procedure. (Please  note  that  the  following  simplified  example  only 
demonstrates  the  basic  idea  behind  the  traceback  routine.  We  use  many 
more  arrays  and  process  more  information  in  the  code.  For  a description 
of  the  code,  please  see  the  appendix.) 

For  the  traceback  example,  we  use  two  arrays;  K(i)  indicates  the 
reason  the  new  facility  i is  located  (K(i)  = 1 means  a EN-string  became 
tight  and  caused  the  location  of  the  new  facility  i,  K(i)  = 2 means  a NN- 
string  became  tight)  and  J(i)  indicates  the  index  of  the  facility  that 
caused  the  location  of  the  new  facility  i.  Consider  an  example;  we  have 
the  following  tree  and  the  current  string  lengths. 
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Select  Eg;  the  shortest  string  corresponds  to  Ng  and  it  reaches  E^. 
Fasten  the  strings  from  Eg  at  E^.  The  shortest  string  lengths  at  E^  are 
2,  11,  15  and  14  corresponding  to  new  facilities  1,  2,  3 and  4 
respectively.  All  these  strings  originate  from  Eg. 

Select  E^;  the  shortest  string  corresponds  to  Ng  and  it  does  not  reach 
E2.  (Note  this  string  originates  from  Eg,  thus  K(l)  = 1,  J(l)  = 1.) 
Locate  Ng  2 units  away  from  E^.  Corresponding  strings  from  E2  and  Eg 
reach  Ng . Engage  strings  of  length  3 and  10  corresponding  to  new 
facilities  2 and  3 respectively,  at  Ng. 

Select  Eg;  the  shortest  string  corresponds  to  Ng  and  it  does  not  reach 
Eg.  Locate  Ng  2 units  away  from  Eg  (K(3)  = 1,  J(3)  =3).  Corresponding 
strings  from  Eg,  Eg  and  Ng  reach  Ng.  Engage  a string  of  length  4 
corresponding  to  the  new  facility  2. 

Select  Ngj  the  shortest  string  corresponds  to  Ng  and  it  does  not  reach 
Eg.  Locate  Ng  3 units  away  from  Ng  (towards  Eg).  (K(2)  = 2,  J(2)  = 1) 

At  this  point,  we  have  the  following  locations: 


®-d> 


♦ 


2 


3 


2 


4 
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The  corresponding  string  from  E2  does  not  reach  N2: 

violation  = actual  distance  - string  length  =2-1=1. 

The  string  from  does  not  reach  N2> 
violation  =6-4=2. 

The  maximum  violation  resulting  from  the  location  of  the  new  facility  2 
occurs  between  new  facilities  2 and  3.  Trace  back  the  partial  paths: 

The  partial  path  ending  at  : 

The  path  goes  from  N2  back  to 

K ( 2 ) = 2, 

J(2)  = 1, 

The  path  goes  from  back  to 
K(l)  = 1,  an  existing  facility, 

J(l)  = 1,  to  existing  facility  1. 

Since  we  have  reached  an  existing  facility,  we  finished  constructing  one 
of  the  two  partial  paths: 


a new  facility, 
to  new  facility  1. 


And  now  the  partial  path  ending  at  N^: 


The  path  goes  from  back  to 
K(3)  = 1, 

3(3)  = 3, 


an  existing  facility, 
the  existing  facility  3. 


The  second  partial  path  is  also  constructed 


ftk  (?) 

Thus  the  violated  path  is 

A A — A © ' 

We  can  construct  the  entering  column  now  (We  use  the  indices  1,  2,  3 and 
4 for  the  existing  facilities  1,  2,  3,  and  4 and  the  indices  5,  6 and  7 
for  the  new  facilities  1,  2 and  3 respectively.  We  use  two  digit 
indices,  the  first  digit  corresponding  to  the  existing  and  the  second 
digit  corresponding  to  the  new  facility): 

index:  15  16  17  25  26  27  35  36  37  45  46  47  56  57 

vector:  (1  0000000000  1 1 1) 

The  entering  column  has  a reduced  cost  of  -2  (amount  of  violation). 

Since  SLP  terminates  after  discovering  infeasibility,  we  do  not 
get  to  price  out  alT  of  the  nonbasic  columns.  However,  we  do  enter  the 
column  with  the  most  negative  reduced  cost  from  among  a subset  of  all 
nonbasic  columns.  Furthermore,  the  order  of  SLP  is  linear  in  m as 
opposed  to  a cubic  effort  for  the  two  shortest  path  approaches.  Due  to 
the  nature  of  the  problems  we  study,  we  would  expect  to  have  m 
substantially  larger  than  n.  This  order  advantage  of  SLP,  coupled  with 
its  desirable  property  of  picking  direct  paths  only,  and  the  above 


selection  procedure,  leads  us  to  expect  shorter  running  times  for  this 
version  of  column  generation. 

In  the  next  section,  we  describe  our  computational  experiment  and 
report  the  results.  Summaries  of  the  two  parts  of  the  experiment  are 
provided  on  pages  128  and  142. 

4.5  Computational  Experimentation 

Summarizing  the  order  analysis,  in  Section  4.3  we  pointed  out  that 

2 

the  update  of  the  basis  inverse  matrix  will  take  0(q  ) effort  where  q is 
2 

of  order  (mn+n  ).  In  Section  4.4,  we  noted  that  finding  an  entering 

2 

column  (in  the  case  Z >_  0)  will  take  order  (m(m+n)  ) effort  using 

Dijkstra's  algorithm  and  order  ((m+n)  ) effort  using  Floyd's  algorithm. 

The  lowest  order  column  pricing  procedure  is  SLP.  The  dominating  effort 

in  one  iteration  of  the  column  generation  scheme  will  then  definitely  be 

the  effort  needed  to  update  the  basis  inverse  if  we  use  SLP  to  construct 

the  entering  paths.  If  we  use  one  of  the  other  procedures  discussed  in 

Section  4.4,  the  dominating  effort  will  depend  on  the  relation  between  n 

2 

and  m.  However,  if  n or  n is  of  order  m,  then  the  basis  inverse 
revision  will  still  dominate. 

For  our  experiment  with  the  column  generation  procedures  we  use 
the  minisum  problem  with  EN  and  NN-type  distance  constraints  and  EN  and 
NN-type  objective  function  terms,  with  G = I,  an  identity  matrix.  This 
problem  is  relatively  simple  to  code,  yet  it  utilizes  most  of  the  aspects 
of  the  column  generation  procedure.  We  compare  the  different  versions  of 
the  procedure  for  several  problem  sizes.  We  use  problems  with  20,  30,  40 
and  50  existing  and  3,  5,  6 and  8 new  facilities.  The  experiment 
consists  of  two  parts.  In  the  first  part  we  compare  the  performance  of 


the  alternative  methods  that  are  discussed  in  this  chapter.  For  this 
part  we  use  smaller  problems  (20  and  30  existing,  3 and  5 new 
facilities),  due  to  time  requirements  of  some  of  the  codes.  For  each 
code  we  experiment  with  we  solve  5 problems  for  a given  combination  of 
existing  and  new  facility  numbers.  Thus,  for  a given  problem  size,  each 
code  solves  the  same  set  of  (5)  problems.  We  use  the  same  set  of  (5) 
trees  for  the  problem  sets  with  the  same  number  of  existing  facilities. 

In  the  second  part  we  experiment  further  with  the  code  that  performed  the 
best  in  the  first  part.  Tables  4.1  and  4.2  summarize  our  experimental 
design. 


Table  4.1:  The  design  used  in  the  first  part  of  the  experiment.  In 

each  block,  a total  of  5 problems  are  solved;  each  problem  is 
solved  by  all  six  codes. 


n 

Code 

m 

20 


30 


Table  4.2:  The  design  used  in  the  second  part  of  the  experiment.  In 

each  block,  5 problems  are  solved  using  code  S. 


3 5 


n 3 5 6 8 

m 

20 


30 


40 


50 
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All  the  codes  are  written  in  FORTRAN  77  and  run  overnight  on  an 
Amdahl  470  of  the  MTS  (Michigan  Terminal  System) , using  the  FORTRANVS 
compiler  and  a code  optimization  level  of  3 (this  is  a higher 
optimization  level  than  the  levels  offered  by  FORTRAN-G  or  FORTRAN-H).  A 
memory  of  8 common  blocks  is  available  to  us,  each  block  holding  slightly 
more  than  1 Mega-byte;  we  use  at  most  2 Mega-bytes.  The  problem  data  is 
generated  using  the  systems  random  number  function  GGUBFS.  The  programs 
are  timed  in  miliseconds  using  the  system  subroutine  TIME. 

In  the  first  part  of  the  experiment,  all  of  the  codes  use  the 
following  steps,  which  we  explain  in  more  detail  in  the  next  paragraph. 

For  coding  purposes,  instead  of  using  s,  . and  r for  bounds  on 
distances,  we  use  a one-dimensional  vector,  a vector  of  upper  bounds,  b. 

(i  = 1,  •••»  q).  Consequently,  we  use  z^  to  be  the  corresponding 
variable  in  the  problem. 

Step  1:  Generate  the  problem  data. 

Step  2:  Check  the  consistency  of  the  distance  constraints  using 

the  separation  conditions  and  if  necessary  modify  the 
data  to  achieve  feasibility. 

Step  3:  Check  for  the  reduced  costs  of  the  slack  and  surplus 

variables . 

r : min  { z . : all  i } = z . , 
a l J 

r,  : min  { b.  - z.  : all  i } = b,  - z,  . 
b ii  k k 

If  r^  or  r^  is  negative,  then  enter: 

the  slack  corresponding  to  z , if  r^  < r^, 
the  surplus  corresponding  to  z,  , if  r r 

K 3.  D 


Repeat  Step  3, 
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Step  4:  If  ra  and  in  Step  3 are  both  nonnegative,  check  the 

separation  conditions  (using  one  of  the  techniques  in 
4.4),  enter  a violated  path  into  the  basis  if  there  is 
one  and  return  to  Step  3.  Stop  if  there  is  no  violated 
path. 

The  problem  generation  is  performed  using  the  same  methods  as 
described  in  Chapter  3.  To  generate  the  tree,  the  arc  lengths,  and  the 
weights  of  the  facilities,  we  use  the  same  parameters  and  techniques  as 
in  Chapter  3.  To  reduce  numerical  difficulties  all  of  the  data  is 
integer.  To  generate  the  upper  bound  of  a distance  constraint,  we  use 
the  formula  A*R+B,  where  R is  a (0,1)  uniform  random  number  and  A and  B 
are  parameters  that  depend  on  the  problem  size.  When  generating  bounds 
for  the  EN-constraints,  we  use  the  following  A and  B values,  depending  on 
the  number  of  the  existing  facilities: 

m 20  30  40  50 

A 25  30  35  40 

B 5 5 5 5 

Likewise,  when  generating  the  bounds  for  the  NN-constraints,  we  use  the 
following  A and  B values,  depending  on  the  number  of  the  new  facilities: 

n 3 5 6 8 

A 20  15  15  10 

B 2 2 2 2 

These  A and  B values  were  selected  after  some  empirical  testing. 
They  yield  "good"  problems,  in  the  sense  that  at  optimum  several  distance 
constraints  are  tight.  These  parameters  result  in  8 - 15%  of  the 
distance  constraints  being  tight. 
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The  randomly  generated  problem  may  be  infeasible.  We  cheek  the 
feasibility  of  the  generated  problem  before  we  start  solving  it.  We  find 
the  shortest  paths  between  every  pair  of  E-nodes  in  the  network  BC,  which 
is  constructed  using  the  upper  bounds  on  the  distances  between  pairs  of 
facilities  as  arc  lengths.  Using  these  shortest  path  lengths  we  check 
the  separation  conditions.  If  the  conditions  are  satisfied  then  we  solve 
the  problem  using  column  generation.  Otherwise,  we  increase  the  first 
upper  bound  that  causes  a violation  by  the  amount  of  the  violation  plus  a 
random  number  between  0 and  5.  The  random  number  is  added  to  avoid  a 
simple  problem  with  many  tight  constraints.  Although  the  column 
generation  scheme  can  detect  infeasibility  (in  the  transformation  of  the 
basis),  the  computational  times  will  not  reflect  the  performance  of  the 
algorithm  if  many  of  the  test  problems  are  terminated  due  to 
infeasibility. 

As  outlined  in  the  procedure,  we  prefer  to  enter  a slack  or  a 
surplus  variable  to  finding  a violated  path.  (Note  this  is  a different 
order  compared  to  the  one  given  in  the  initial  statement  of  COLGEN.  For 
G = I,  the  GZ  _<  b test  reduces  to  Z _<  b,  which  is  simple  to  check).  The 
reason  for  this  practice  is  to  avoid  (if  possible)  the  construction  of  a 
violated  path  in  Step  4.  For  the  codes  that  use  shortest  path 
algorithms,  computing  of  the  shortest  paths  is  a time-consuming  process. 
The  same  is  not  necessarily  true  for  SLP,  however  for  uniformity  we  use 
the  same  sequence  for  checking  of  reduced  costs.  In  the  second  part  of 
the  experiment,  which  studies  SLP  exclusively,  we  change  the  column 
pricing  order  in  an  effort  to  cut  down  the  number  of  iterations  to  solve 


a problem. 


In  Step  3,  if  we  encounter  a negative  reduced  cost  (for  a slack  or 
surplus  variable)  then  we  enter  the  column  with  the  most  negative  reduced 


cost  into  the  basis.  If  the  slack  variable  j is  selected  (i.e.  if  z.  < 0 

J 

for  some  j),  then  we  enter  the  unit  vector  e^  into  the  basis;  if  the 
surplus  variable  k is  selected,  (i.e.  if  z^  > b^  for  some  k)  then  we 
enter  the  negative  unit  vector  -e^  into  the  basis.  We  repeat  this  step 
until  all  slack  and  surplus  variables  have  nonnegative  reduced  costs. 

In  Section  4.4  we  discussed  several  ways  of  selecting  the  entering 
column,  to  be  used  in  Step  4 of  the  above  description  and  gave  some 
detail.  We  refer  the  reader  to  Appendix  B for  access  to  the  codes.  The 
shortest  path  algorithms  (Dijkstra  and  Floyd)  are  reasonably  easy  to  code 
and  facilitate  construction  of  violated  paths  using  a set  of  pointers  or 
labels.  SLP  is  the  most  difficult  procedure  to  code. 

For  the  pivot  operations,  we  use  standard  revised  simplex.  During 
a pivot,  we  first  transform  the  entering  column  by  multiplying  it  with 
the  basis  inverse.  If  the  entering  column  is  e^.  (a  slack  variable)  then 
the  transformed  column  is  simply  the  column  of  the  current  basis 
inverse;  if  the  entering  column  is  -e^  (a  surplus  variable)  then  the 
transformed  column  is  the  negative  of  the  k*"^1  column  of  the  current  basis 
inverse.  If  the  entering  column  corresponds  to  a violated  path,  the 
transformation  is  reduced  to  several  additions,  since  in  this  case  the 
entering  column  only  consists  of  +1  and  0 entries.  We  then  find  the 
pivot  entry  in  the  entering  column  using  the  minimum  ratio  test  and 
perform  the  necessary  row  operations  to  transform  the  entering  column  to 
a unit  vector.  The  sparsity  of  the  entering  column  and  the  basis  inverse 
speed  up  the  transformation  process  considerably.  Rows  that  have  a zero 
entry  in  the  pivot  column  are  not  updated.  Similarly,  we  skip  over 
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columns  that  have  a zero  entry  in  the  pivot  row.  These  techniques  prove 
to  be  effective  since  the  basis  inverse  is  usually  very  sparse  (from  93% 
to  over  99%). 

Most  of  the  memory  used  by  the  codes  is  consumed  to  store  the 
basis  inverse.  The  basis  inverse  is  a matrix  of  size  (mn+n(n-l)/2) . For 
a problem  with  50  existing  and  8 new  facilities,  there  are  (428)  entries 
in  the  matrix  and  the  matrix  takes  up  almost  1.5  Mega-bytes  of  memory, 
using  double  precision.  We  store  all  entries  in  the  inverse  matrix, 
which  can  be  more  than  99%  sparse.  This  is  not  an  efficient  use  of 
space.  It  is  possible  to  store  the  information  in  the  inverse  matrix  in 
a condensed  fashion,  by  only  storing  the  nonzero  entries  and  a set  of 
pointers  that  indicate  the  locations  of  the  nonzero  entries.  However, 
this  complicates  the  code  and  the  basis  update  operations  may  take  more 
time.  For  the  largest  problems  in  our  experiment,  the  memory  available 
to  us  was  sufficient;  we  did  not  implement  a condensation  of  the  basis 
inverse.  However,  for  larger  problems  (for  example  100  existing  and  10 
new  facilities)  this  modification  is  inevitable,  given  our  memory 
limitations. 

In  the  experiment,  we  measure  the  total  CPU  time,  the  time  spent 
for  the  column  selection  process,  the  time  for  the  update  of  the  basis 
inverse,  the  total  number  of  pivots,  and  the  number  of  times  a slack  or  a 
surplus  variable  is  entered  into  the  basis  (blocks  (1)  and  (3)  of 
COLGEN).  The  CPU  measures  do  not  include  problem  generation,  feasibility 
testing  or  calculation  of  statistics  and  output;  they  do  include  the 
"sweeping"  times,  a process  we  describe  next. 

In  the  early  stages  of  the  experiment  we  encountered  some 
difficulties  due  to  numerical  instability  when  running  larger  problems. 


To  counter  these,  we  use  the  following  techniques.  When  checking  for  an 
inequality  between  two  numbers,  say  C <_  D,  we  consider  the  inequality  to 
be  violated  only  if  C > D + E,  where  E is  a small  number.  We  use  this 
error  margin  for  separation  condition  checks  in  all  codes  but  the  one 
using  SLP.  In  code  S,  a string  is  considered  to  "reach"  if  it  comes 
within  E of  the  facility  it  is  pulled  towards.  In  Step  3 of  the  above 
outline,  if  -E  _<  _<  0,  then  we  set  z^  = 0 and  if  b^  <_  z^  <_  b^  + E,  then 

we  set  z^  = b^,  to  prevent  cycling  due  to  numerical  inaccuracy.  Each 
entry  in  the  transformed  entering  column  and  the  pivot  row  at  every 
iteration  is  checked  and  entries  that  are  within  E of  zero  are  set  to 
zero.  Furthermore,  we  "sweep"  the  basis  inverse  every  50  iterations. 
From  our  computations  we  know  that  the  basis  inverse  is  extremely  sparse. 
All  entries  that  are  within  E of  0 are  set  equal  to  0 during  this  sweep. 
We  also  found  that  .5,  1,  2,  -.5,  -1  and  -2  appear  with  great  regularity 
in  the  basis  inverse.  We  correct  for  deviations  from  these  numbers  as 
well  during  the  sweep.  During  the  sweep  we  also  count  the  number  of  zero 
entries  in  the  matrix  to  measure  the  sparsity.  After  we  correct  the 

basis  inverse,  we  recalculate  B_1b  (the  right-hand  side).  We  use 

—8 

E = 10  throughout  the  experiment.  The  selection  of  E is  somewhat 
arbitrary.  We  experimented  with  several  values  of  E;  the  differences  in 
results  (number  of  iterations)  were  insignificant. 

During  the  experiment  we  also  used  a Pascal  code  (Francis  1985)  to 
solve  the  same  problems.  The  Pascal  code,  which  is  very  similar  to  the 
FORTRAN  code,  is  run  on  a personal  computer  and  prints  out  the  objective 
function  value  and  the  entering  column  at  every  iteration.  While 
experimenting  with  the  Pascal  code  we  observed  that  the  majority  of  the 
columns  entered  have  three  or  less  nonzero  entries.  This  may  be  another 
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reason  for  the  basis  inverse  being  consistently  sparse.  We  also  found  in 
general  that  the  code  had  to  go  through  a considerable  amount  of 
iterations  after  coming  very  close  to  optimality.  Dzielinski  and  Gomory 
(1965)  note  that  problems  with  many  columns  often  have  a tremendous 
number  of  near-optimal  solutions  and  hence  the  convergence  may  be  slow  in 
column  generation. 

We  now  proceed  to  the  results  of  the  experiment.  In  the  first 
part  of  the  experiment  we  compared  the  different  versions  of  the  column 
generation  scheme  for  problems  with  20  and  30  existing  and  3 and  5 new 
facilities. 

We  first  compared  the  two  versions  of  column  pricing  using 
Dijkstra's  shortest  path  algorithm,  stated  in  Section  5.4.1.  We  denote 
the  version  that  continues  finding  shortest  paths  until  the  first 
violated  path  is  found  by  Dl.  On  the  Qther  hand,  D2  is  the  version  that 
finds  all  shortest  paths  between  an  E-node  and  all  other  E-nodes. 
Consequently,  D2  may  find  several  columns  with  negative  reduced  costs. 

In  the  following  tables  we  list  the  mean  and  the  standard  deviation  of 
the  number  of  iterations  (rounded  to  the  nearest  integer)  and  CPU  times 
to  solve  5 test  problems  for  codes  Dl  and  D2. 

Table  4.3:  Means  (and  standard  deviations)  of  the  number  of  iterations 

and  the  CPU  times  in  seconds  per  problem  solved  using  the  codes  Dl 
and  D2,  based  on  a sample  of  5 problems  for  each  problem  size. 


(m,n): 

(20,3) 

(30,3) 

(20,5) 

(30,5) 

no.  of  iter. 

Dl 

1260  (563) 

2208  (931) 

4207  (1087) 

9841  (3306) 

D2 

929  (357) 

1256  (339) 

2319  (601) 

7956  (3504) 

CPU  seconds 

Dl 

3.5  (1.5) 

11.2  (4.3) 

17.0  (4.8) 

76.3  (31.1) 

D2 

2.8  (1.2) 

7.3  (2.1) 

9.7  (2.9) 

71.9  (43.4) 

For  both  codes,  the  average  number  of  iterations  increases  with 
the  basis  size  (mn+n(n— 1 )/2) . The  standard  deviations  are  very  high, 
suggesting  large  variations  in  the  number  of  iterations  and  the 
computational  times  for  a given  problem  size.  (The  maximum  and  the 
minimum  number  of  iterations  produced  by  D1  for  problems  of  size 
(m,n)  = (30,5)  are  13,652  and  5,196  respectively.)  We  have  made  similar 
observations  at  all  stages  of  the  experiment  (with  all  of  the  codes). 

Both  codes  spend  on  the  average  roughly  half  of  the  CPU  time  for 
the  column  selection  process  (53%  for  Dl,  58%  for  D2).  The  rest  is  spent 
on  basis  inverse  update,  sweeping  and  bookkeeping.  Both  codes  enter  a 
column  that  corresponds  to  a path  (as  opposed  to  a slack  or  a surplus 
variable)  in  78%  to  82%  of  the  iterations.  The  sparsity  of  the  basis 
inverse  matrix  for  both  codes  is  between  94%  and  97%. 

As  to  the  comparison  of  the  two  codes,  D2  yields  (from  19%  to  45%)  a 
lower  average  number  of  iterations  and  uses  (from  6%  to  43%)  less  CPU 
time  (average)  than  Dl , for  all  problem  sizes.  For  the  20  problems 
solved,  D2  used  less  CPU  time  and  went  through  less  iterations  on  all  but 
one  problem.  (A  problem  with  (m,n)  = (30,5),  that  took  7,900  iterations 
(and  53  seconds)  with  Dl,  took  13,342  iterations  (and  143  seconds)  with 
D2.  When  solving  this  problem,  D2  entered  a slack  variable  3,665  times, 
which  is  about  three  times  the  number  of  slack  variables  entered  for  an 
average  problem  of  this  size.  If  we  exclude  this  problem,  the  average 
number  of  iterations  goes  down  to  6,610  and  the  time  goes  down  to  54.1 
seconds . ) 

Since  D2  may  consider  several  columns  with  negative  reduced  costs, 
it  is  expected  to  go  through  fewer  iterations  than  Dl.  However,  it  is 
also  expected  to  spend  more  time  in  column  selection.  The  experiment 
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suggests  that  the  additional  time  used  in  D2  for  column  selection  is  not 
significant.  The  drop  in  the  number  of  iterations  is  marginally  more 
drastic  than  the  drop  in  the  CPU  times  (as  we  go  from  D1  to  D2), 
suggesting  that  the  time  per  iteration  goes  up  slightly.  Also,  the 
percentage  of  the  time  D2  spends  for  column  generation  is  marginally 
higher  (by  about  3%  on  the  average)  than  the  time  D1  spends  for  the  same 
purpose.  However,  the  additional  time  spent  for  column  pricing  is 
apparently  "worth  the  effort"  and  reduces  the  overall  time  requirement. 

We  decide  to  use  D2  for  further  testing. 

We  next  test  the  effect  of  restricting  the  selected  columns  to 
direct  paths,  as  described  in  Section  4.4.3.  In  the  tables  below,  DD  and 
DF  are  the  versions  of  D2  and  F that  enter  only  direct  paths  into  the 
basis. 

Table  4,4;  Means  (and  standard  deviations)  of  the  number  of  iterations 
and  the  CPU  times  in  seconds  per  problem  solved  using  the  codes  D2 
and  DD2,  based  on  a sample  of  5 problems  for  each  problem  size. 


(m,n) : 

(20,3) 

(30,3) 

(20,5) 

(30,5) 

no.  of  iter. 

D2 

DD 

929  (357) 
479  (178) 

1256  (339) 
667  (251) 

2319  (601) 

1361  (447) 

7956  (3504) 
2056  (801) 

CPU  seconds 
D2 
DD 

2.8  (1.2) 
1.8  (0.8) 

7.3  (2.1) 
5.6  (2.6) 

9.7  (2.9) 
6.6  (2.4) 

71.9  (43.4) 
22.3  (9.4) 
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Table  4.5:  Means  (and  standard  deviations)  of  the  number  of  iterations 

and  the  CPU  times  in  seconds  per  problem  solved  using  the  codes  F 
and  DF,  based  on  a sample  of  5 problems  for  each  problem  size. 


(m,n) : 

(20,3) 

(30,3) 

(20,5) 

(30,5) 

no.  of  iter. 

F 

205  (27) 

320  (72) 

469  (162) 

997  (301) 

DF 

184  (18) 

252  (55) 

336  (92) 

574  (142) 

CPU  seconds 

F 

2.5  (0.5) 

10.2  (3.1) 

6.3  (2.2) 

33.6  (8.9) 

DF 

2.3  (0.3) 

8.8  (2.6) 

5.0  (1.2) 

23.5  (5.8) 

The  versions  that  only  enter  the  direct  paths  are  more  efficient. 
Using  DD  instead  of  D2  reduces  the  average  number  of  iterations  by  41%  to 
74%  and  the  average  computational  time  by  23%  to  69%  on  the  four  problem 
groups.  (The  problem  that  took  over  13,000  iterations  with  D2  was  solved 
with  a little  over  1,000  iterations  with  DD.)  Using  DF  instead  of  F 
results  in  reductions  of  10%  - 42%  in  the  average  number  of  iterations 
and  8%  - 30%  in  the  average  CPU  times.  In  all  twenty  problems  tested,  DD 
and  DF  resulted  in  less  iterations  and  less  computational  effort  than  D2 
and  F respectively. 

The  reductions  in  the  number  of  iterations  are  more  drastic  than 
the  reductions  in  the  computational  times,  suggesting  higher  average  time 
per  iteration  for  the  direct  versions  of  the  algorithms.  The  percentage 
of  time  spent  by  DD  on  column  generation  is  between  56%  and  81%, 
considerably  more  than  for  D1  (46%  - 70%).  This  is  expected,  since  each 
path  that  is  considered  as  a candidate  must  be  traced  to  determine 
whether  it  is  a direct  path  or  not.  In  F,  85%  to  95%  of  the  CPU  time  is 
spent  in  the  column  generation  segment  (Floyd's  algorithm);  in  DF,  the 
percentages  of  the  CPU  time  spent  for  column  generation  are  higher  than 
in  F by  1%  to  3%. 
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The  reductions  for  the  Dijkstra  based  version  are  very  drastic. 

The  average  number  of  iterations  are  cut  by  almost  half  or  more  for  all 
problem  sizes.  For  some  individual  problems,  the  number  of  iterations 
are  cut  to  a tenth.  Also,  DD  enters  a path  into  the  basis  83%  to  89%  of 
the  time,  slightly  higher  than  D2.  Codes  DF  and  DD  generated  slightly 
sparser  (by  about  1%)  basis  inverse  matrices  than  their  counterparts,  F 
and  Dl. 

Based  on  the  evidence  provided  by  this  part  of  the  experiment  we 
conclude  that  the  direct  versions  of  the  codes,  DD  and  DF  are  in  general 
more  efficient  than  D2  and  F and  we  decide  to  consider  these  direct 
versions  for  further  comparison. 

We  proceed  to  the  comparison  of  the  shortest  path  based  codes  with 
the  SLP  based  code.  In  the  next  table,  we  summarize  the  statistics  for 
three  codes;  DD  (from  Table  4.4),  DF  (from  Table  4.5),  and  S,  which  is 
the  SLP  based  version. 

Table  4.6:  Means  (and  standard  deviations)  of  the  number  of  iterations 

and  the  CPU  times  in  seconds  per  problem  solved  using  the  codes  S, 
DF  and  DD,  based  on  a sample  of  5 problems  for  each  problem  size. 


(m,n) : 

(20,3) 

(30,3) 

(20,5) 

(30,5) 

no.  of  iter. 

S 

172  (46) 

243  (44) 

442  (188) 

698  (152) 

DF 

184  (18) 

252  (55) 

336  (92) 

574  (142) 

DD 

479  (178) 

667  (251) 

1361  (447) 

2056  (801) 

CPU  seconds 

S 

.2  (.07) 

.6  (.1) 

1.2  (.6) 

2.9  (.7) 

DF 

2.3  (0.3) 

8.8  (2.6) 

5.0  (1.2) 

23.5  (5.8) 

DD 

1.8  (0.8) 

5.6  (2.6) 

6.6  (2.4) 

22.3  (9.4) 

Although 

DD  prices  out 

only  a subset 

of  all  columns, 

its 

performance  is  comparable  to  DF.  The  Dijkstra  based  code  goes  through 
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roughly  2.5  to  4 times  as  many  iterations  as  the  Floyd  based  code; 
however  the  CPU  times  used  by  these  two  codes  are  not  significantly 
different.  Although  DF  went  through  less  iterations  on  all  but  one  of 
the  20  problems,  DD  solved  13  of  the  problems  in  less  CPU  time.  It  is 
not  clear  that  the  additional  effort  to  find  all  shortest  paths  in  every 
iteration  (as  DF  does)  is  justified. 

The  code  DD  spends  56%  to  81%  of  the  average  CPU  time  on  column 
selection,  compared  to  88%  to  96%  for  DF.  As  to  the  sparsity  of  the 
basis  inverse  matrix,  DF  results  in  somewhat  sparser  inverse  (by  .5%  to 
1.5%)  than  DD,  mainly  due  to  the  lower  number  of  iterations. 

The  average  number  of  iterations  the  code  S goes  through  is  very 
similar  to  those  of  the  code  DF.  This  remarkable  performance  of  the  SLP 
based  version  is  surprising,  because  DF  prices  out  all  columns 
(corresponding  to  shortest  paths  in  network  BC)  and  then  enters  the  one 
with  the  lowest  negative  reduced  cost,  whereas  S prices  out  only  a few 
columns  with  negative  reduced  costs.  (For  example,  in  the  problem  set 
with  (m,n)  = (20,3),  S discovers  on  the  average  7 to  11  violated  paths 
per  iteration.  Hence  the  column  selection  is  made  from  a small  set  of 
favourable  columns.)  The  code  S actually  needed  fewer  iterations  than 
the  code  DF  in  8 out  of  the  20  problems;  there  was  only  one  problem  for 
which  S had  to  go  through  more  than  twice  as  many  iterations  as  DF  did. 

The  CPU  times  reveal  a clear  superiority  of  the  SLP-based  version 
over  all  other  versions.  For  all  of  the  problem  sizes  studied,  the 
computational  time  for  S is  about  an  order  lower  than  for  the  other 
codes.  This  is  the  basic  reason  why  we  decided  to  drop  all  other 
versions  of  the  column  generation  procedure  from  further  experimentation. 
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The  code  S enters  a path  80%  to  82%  of  the  time  for  the  problems 
sizes  we  experimented  with.  The  percentage  of  the  CPU  time  spent  for 
column  generation  (via  SLP)  is  between  24%  and  37%.  Since  all  of  the 
codes  are  very  similar  with  the  exception  of  the  column  generation 
segment,  the  superiority  of  the  code  S has  to  be  due  to  SLP.  For  the 
largest  problems  in  this  part  of  the  experiment  (30  existing  and  5 new 
facilities),  the  code  S spent  about  1.25  times  more  time  than  DF  for 
pivot  operations  and  sweeping,  basically  due  to  larger  number  of 
iterations  on  the  average.  However,  the  code  DF  had  to  spend  31  times 
more  time  than  S for  column  pricing,  for  the  same  problem  set.  We 
conclude  that  the  sequential  location  procedure  consumes  very  little 
computational  time  (compared  to  the  shortest  path  algorithms)  and 
generates  "good"  columns  resulting  in  few  iterations  overall. 

Before  we  move  to  the  second  part  of  the  experiment,  we  make  a 
remark  regarding  the  shortest  path  based  procedures.  We  tested  another 
version  of  the  Dijkstra  based  code  (denoted  by  DDALL;  a version  that 
finds  all  shortest  paths  in  the  network  BC,  to  determine  the  entering 
column.  In  spirit,  this  version  is  no  different  from  the  Floyd  based 
code,  since  they  both  find  all  shortest  paths  (i.e.  do  complete  column 
pricing).  However,  the  order  of  Dijkstra  for  finding  all  shortest  paths 
(0(m(m+n)  ) is  lower  than  the  order  of  Floyd  (0(m+n)  ) and  thus  a 
Dijkstra  based  all  shortest  path  column  generator  may  be  computationally 
more  efficient  than  a Floyd  based  version.  We  solved  5 problems  with  30 
existing  and  5 new  facilities  using  this  alternative  version.  The  code 
DF  used  (Table  5.6)  23.5  seconds  of  CPU  time  per  problem  (with  a standard 
deviation  of  5.8)  and  the  code  DDALL  used  26.0  seconds  (with  a standard 
deviation  of  6.4).  Although  the  Dijkstra  based  version  seems  to  be  about 
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10%  slower  based  on  the  average,  the  two  average  figures  are  within  half 
standard  deviation  of  one  another;  thus,  the  difference  is  insignificant 
for  this  problem  size.  Recalling  (from  Table  5.6)  that  the  code  DD 
(which  does  partial  column  pricing)  uses  an  average  of  22.3  seconds  for 
this  problem  size,  it  is  not  clear  that  pricing  out  all  columns  using 
Dijkstra's  algorithm  is  computationally  more  efficient  than  the  version 
that  prices  out  only  part  of  them,  based  on  this  problem  size.  Perhaps 
for  larger  problems  DDALL  would  be  more  efficient  than  DF.  We  note  that 
rather  than  testing  the  speed  of  different  shortest  path  algorithms,  our 
main  purpose  is  to  empirically  evaluate  the  difference  between  partial 
and  complete  column  pricing,  and  DD  and  DF  serve  this  purpose  well. 

The  shortest  path  based  algorithms  DD,  DF  and  DDALL  all  produce 
similar  computational  time  statistics.  The  superiority  of  the  SLP  based 
code  over  all  other  versions  is  the  most  important  outcome  of  this  part 
of  the  experiment. 

In  the  next  chapter,  we  use  a shortest  path  based  code  to  find  the 
lower  bound  on  the  objective  function  of  some  location  problems  on 
general  networks.  For  that  purpose,  we  use  DF,  which  goes  through  the 
fewest  number  of  iterations  (on  the  average)  and  hence  is  the  code  that 
is  least  prone  to  numerical  inaccuracies.  Also,  DF  produces  the  lowest 
standard  deviation,  which  is  desirable. 

At  the  end  of  the  first  part,  we  summarize  our  findings.  The 
performance  of  every  code  is  erratic,  there  is  little  consistency  among 
the  statistics  for  individual  problems  of  the  same  size.  The  standard 
deviations  of  the  number  of  iterations  and  CPU-times  are  very  high.  All 
codes  enter  a path  (as  opposed  to  a slack  or  surplus  variable)  most  of 
the  time  (80%-90%).  The  basis  inverse  matrices  are  extremely  sparse  (94% 
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to  99%).  The  version  of  the  Dijkstra  based  codes  that  performs  partial 
column  pricing  is  more  efficient  than  the  version  that  enters  the  first 
favourably  priced  column;  however,  complete  column  pricing  (finding  all 
shortest  paths)  does  not  prove  to  be  efficient.  The  versions  of  the 
shortest  path  codes  that  only  enter  direct  paths  are  superior  to  the 
versions  that  allow  indirect  paths  to  enter.  The  SLP  based  version  goes 
through  roughly  the  same  (or  slightly  higher)  number  of  iterations  as  the 
shortest  path  based  versions  that  do  complete  column  pricing.  However, 
SLP  spends  an  order  of  magnitude  less  time  to  solve  the  problems. 

In  the  second  part  of  the  experiment,  we  further  investigate  the 
performance  of  the  SLP-based  version  of  the  general  algorithm  with  larger 
sample  problems.  We  solve  problems  with  20,  30,  40  and  50  existing 
facilities  and  3,  5,  6 and  8 new  facilities.  In  each  problem  group  we 
generate  5 random  problems.  Consequently,  we  obtain  statistics  for  16 
different  problem  sizes,  with  5 separate  problems  for  each  size,  for  a 
total  of  80  problems. 

For  this  part  of  the  experiment,  we  changed  the  order  of  the 
column  pricing  to  utilize  the  SLP  subroutine  more  effectively.  In  Step 
3,  if  we  find  a slack  variable  with  a negative  reduced  cost,  then  we 
enter  the  slack  or  surplus  variable  with  the  most  negative  reduced  cost. 
This  is  the  same  as  in  the  first  part  of  the  experiment.  However,  if  all 
slack  variables  have  nonnegative  reduced  costs  (i.e.  all  z . _>  0)  then  we 
initiate  SLP,  even  though  we  may  have  some  surplus  variables  with 
negative  reduced  costs.  (Recall  that  SLP  requires  nonnegative  string 
lengths.  However,  strings  that  are  longer  than  the  corresponding  upper 
bounds  allow  do  not  prevent  SLP  from  operating.)  Subsequently,  the 
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column  with  the  lowest  reduced  cost  is  picked  to  enter.  This  column  can 
be  a surplus  variable  or  a violated  path. 

We  made  another  modification  for  this  part  of  the  experiment.  In 
the  earlier  version  of  the  code,  we  only  checked  a subset  of  the  strings 
in  SLP,  upon  the  discovery  of  a violation.  In  this  part,  we  check  all  of 
the  corresponding  strings,  and  hence  price  out  more  columns.  This 
version  of  the  code  is  closer  to  the  common  simplex  practice  of  entering 
the  column  with  the  lowest  reduced  cost.  These  two  modifications  did  not 
effect  the  number  of  iterations  in  small  problems  significantly. 

However,  the  number  of  iterations  for  large  problems  were  reduced  by  20% 
to  50%.  The  statistics  we  report  are  based  on  the  modified  code. 

The  following  tables  summarize  the  average  number  of  iterations 
and  the  CPU-times  for  the  problems  solved.  The  standard  deviations  are 
indicated  in  paranthesis. 

Table  4.7:  Average  number  of  iterations  (and  standard  deviations)  for  a 

sample  of  5 problems  in  each  problem  group,  solved  using  column 
generation  using  SLP. 


m 20 

30 

40 

. 50 

n 

3 

179  (48) 

269  (70) 

432  (169) 

671 

(199) 

5 

459  (155) 

738  (159) 

1026  (362) 

1268 

(446) 

6 

784  (234) 

1063  (323) 

1153  (302) 

1519 

(296) 

8 

1233  (186) 

1554  (296) 

2289  (940) 

2438 

(1008) 

Table  4.8: 

Average  CPU-times  in  seconds, 

(and  standard 

deviations) 

based 

on  samples  of 

5 problems  in  each  group. 

m 20 

30 

40 

50 

n 3 

.3  (.08) 

.7  (.2) 

1.6  (.7) 

3.7  (1.3) 

5 

1.3  (.5) 

3.3  (.8) 

6.7  (2.6) 

12.2  (4.7) 

6 

2.6  (.9) 

5.9  (1.9) 

9.5  (2.6) 

17.4  (3.4) 

8 

6.6  (1.5) 

13.2  (2.9) 

40.4  (18.0) 

46.3  (21.6) 

In  an  effort  to  establish  relationships  between  the  basis  size  and 
the  CPU  time,  and  between  the  basis  size  and  the  number  of  iterations,  we 
report  the  average  CPU-times  and  the  average  number  of  iterations  with 
the  corresponding  basis  size  (which  is  mn+n(n-l)/2) . Consequently,  we 
plot  these  average  statistics  versus  the  basis  size. 


Table  4.9:  The  relation  between  the  basis  size  and  the  average  number 

of  iterations  and  the  basis  size  and  the  average  CPU-times  in 
seconds,  based  on  samples  of  5 problems  in  each  group. 


(m,n) 

basis 

avg.  no. 

avg.  comp 

size 

of  iter. 

time  (sec) 

(20,3) 

63 

179.2 

.26 

(30,3) 

93 

268.6 

.65 

(20,5) 

110 

459.2 

1.26 

(40,3) 

123 

431.6 

1.56 

(20,6) 

135 

784.0 

2.62 

(50,3) 

153 

670.6 

3.72 

(30,5) 

160 

738.2 

3.26 

(20,8) 

188 

1233.4 

6.56 

(30,6) 

195 

1063.0 

5.89 

(40,5) 

210 

1026.0 

6.68 

(40,6) 

255 

1152.8 

9.47 

(50,5) 

260 

1267.8 

12.22 

(30,8) 

268 

1554.2 

13.18 

(50,6) 

315 

1519.2 

17.43 

(40,8) 

348 

2889.2 

40.42 

(50,8) 

428 

2438.4 

46.29 

The  relationship  in  both  of  these  plots  is  a direct  one  which 

Q 

seems  to  be  of  the  form  Y = a X . To  estimate  the  parameters  of  this 
curve,  we  fit  a least-squares  line  to  ln(Y)  and  ln(X) , where  "In"  denotes 
the  natural  logarithm.  Note  we  arrive  at  ln(Y)  = In  a + c ln(X)  upon 

Q 

taking  the  natural  logarithms  of  both  sides  of  the  equation  Y = a X . 

The  curve-fitting  using  the  data  in  Table  4.9  results  in  the 
following  statistics,  where  B is  the  basis  size,  I is  the  average  number 
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Figure  4.1:  The  standardized  scatterplot  of  the  average  CPU  times  (Y) 

versus  the  basis  size  (X)  for  the  16  problem  groups  studied. 
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Figure  4.2:  The  standardized  scatterplot  of  the  average  number  of 

iterations  (Y)  versus  the  basis  size  (X)  for  the  16  problem  sets. 


of  iterations,  T is  the  average  CPU— time  in  miliseconds  (please  recall  T 
includes  column  generation,  row  operations  and  sweeping),  s^  is  the 
standards  deviation  of  c,  the  exponent  of  the  curve  and  and  r2  is  the 
goodness-of-f it . 

2 

a c s r 

c 

I = aBc  .56  1.41  .095  .940 

T = aBc  .00338  2.72  .086  .986, 

Note  both  curves  explain  more  than  90%  of  the  variation  in  the 
data.  The  correlation  coefficients  for  these  two  fits  are  .97  and  .99 
respectively,  indicating  very  good  fits.  The  exponent  (parameter  c)  in 
the  curves  is  the  important  parameter,  since  it  describes  the  growth  rate 
of  the  values  of  the  dependent  variable.  The  exponent  in  each  fit  is 
greater  than  one,  confirming  our  observation  of  nonlinear  growth. 
Furthermore,  the  95%  confidence  intervals  around  the  exponents- (plus 
minus  2 standard  deviation)  do  not  include  one;  consequently  there  is 
enough  statistical  evidence  (at  95%  confidence  level)  that  the 
relationships  are  not  linear . However  the  low  values  of  the  exponents 
are  quite  encouraging.  (Note  the  upper  bound  of  the  3 standard  deviation 
confidence  interval  on  the  exponent  for  the  curve  describing  the  number 
of  iterations  as  a function  of  the  basis  size  is  less  than  1.7.)  The 
nonlinear  growth  is  not  drastic;  we  may  be  able  to  solve  problems  of 
larger  sizes  in  a reasonable  number  of  iterations,  provided  that  these 
functions  can  be  extrapolated  reasonably  accurately. 

We  next  give  the  standardized  scatterplots  of  In  (I)  versus 
In  (B),  In  (T)  versus  In  (B)  and  the  corresponding  residuals.  The  ln-ln 
plots  visually  confirm  the  linearity  of  the  ln-ln  relations.  The  plots 
of  the  residuals  indicate  that  all  of  the  errors  are  well  within  the  3 
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Figure  4.3:  The  standardized  scatterplot  of  the  natural  logarithms  of 

the  average  number  of  iterations  (YL)  versus  the  natural  logarithms 
of  the  basis  size  (XL)  for  the  16  problem  groups  studied. 
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Figure  4.4:  The  standardized  scatterplot  of  the  natural  logarithms  of 

the  average  CPU-times  (YL)  versus  the  natural  logarithms  of  the 
basis  size  (XL)  for  the  16  problem  groups  studied. 
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Figure  4.6:  The  standardized  scatterplot  of  the  residuals  resulting 

from  the  In-ln  fit  of  the  average  CPU-times  versus  the  basis  size 
for  the  16  problem  groups  studied. 
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standard  deviation  limits  and  that  there  is  no  pattern  in  the  residual 
terms,  which  is  a further  confirmation  of  the  fit. 

We  also  fitted  the  curve  I = a Bc  with  all  of  the  data  points  we 
have,  instead  of  the  averages.  Thus  our  sample  size  for  this  set  of  fits 
is  5x16  = 80.  The  results  are  as  follows: 

2 

a c s r 

c 

I = aBc  .56  1.41  .924  .805 

T = aBc  .00335  2.73  .996  .930 

Observe  that  the  parameters  did  not  change  very  much.  However, 
the  standard  deviation  figures  went  up  drastically.  The  reason  for  this 
effect  is  the  high  variation  of  the  number  of  iterations  (and  the  CPU- 
times)  within  the  problems  of  the  same  size.  For  this  last  set  of  fits 
we  compute  the  following  statistics  to  identify  the  contributions  of  the 
two  different  sources  of  variation  and  use  a lack  of  fit  test,  as 
described  by  Neter  and  Wasserman  (1974). 


Table  4.10:  Statistics  based  on  the  set  of  80  problems  and  the  ln-ln 

fits.  SST0T  is  the  sum  of  the  squared  deviations  of  In  (I)  values 
from  their  mean,  SSE  is  the  sum  of  the  squared  errors,  SSPE  is  the 
sum  of  the  squares  of  pure  errors  (sum  of  the  squared  deviations  of 
the  satistics  from  the  average  statistic  for  the  corresponding 
problem  size)  and  SSLF  is  the  difference  between  SSE  and  SSPE. 


I = a BC 

T = a B' 

SST0T 

48.81 

158.07 

SSE 

9.54 

11.07 

SSPE 

6.86 

9.07 

SSLF 

2.68 

2.00 

Please  note  that  SSPE  is  a measure  of  variation  within  the 
problems  of  the  same  size  and  SSLF  is  a measure  of  variation  around  the 
regression  line.  We  use  the  following  test  statistic  for  the  linearity 


test: 
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F*  = SSLF  (n-k)  / SSPE  (k-2), 

where  n is  the  total  number  of  the  problems  (80)  and  k is  the  number  of 
the  problem  sets  of  different  sizes  (16).  Neter  and  Wasserman  (1974) 
state:  " Since  SSLF  and  SSPE  are  additive,  as  are  the  degrees  of  freedom, 
we  know  from  Cochran’s  theorem  that  F follows  the  F(k-2,n-k) 

distribution  if  the  regression  function  is  linear The  decision  rule 

to  control  the  risk  of  a Type  1 error  at  a is:  If  F < F(l-a,k-2,n-k) , 
then  conclude  E(Y)  = Bq  + X.". 

For  this  test  we  are  using  the  linear  relation  between  the 
parameters,  namely  In  Y = In  a + c In  X.  If  we  can  conclude  (as  a result 
of  the  F-test)  that  this  relationship  is  linear,  then  we  also  have  enough 
evidence  that  the  relationships  we  are  studying  (number  of  iterations  and 
CPU-time  versus,  the  basis  size)  are  of  the  form  Y = a Xc.  With  n = 80 
and  k = 16,  we  get  F =1.78  and  F =1.01  for  the  two  lines.  Since 
F(. 95, 14, 64)  = 2.089,  we  conclude  that  the  ln-ln  relationships  are 
linear . 

We  note  that  the  exponent  of  the  curve  that  describes  the  time- 
size  relationship  is  considerably  larger  than  the  exponent  of  the  curve 
that  describes  the  number  of  iterations-size  relationship.  This  would 
suggest  that  the  time  per  iteration  increases  with  the  problem  size. 

This  is  expected,  since  the  dominating  effort  per  iteration  (pivot 
operations  and  sweeping)  is  quadratic  in  the  basis  size.  To  test  this, 
we  fit  a curve  of  type  Y = aX  , using  the  time  per  iteration  data  as  the 
dependent  and  the  basis  size  as  the  independent  variable.  The  exponent 
of  the  curve  is  1.31  (with  a standard  deviation  of  .049);  the  fit  yields 
a correlation  coefficient  of  .99.  It  is  reassuring  to  see  that  the 
exponents  of  the  "iteration  count  - basis  size"  curve  and  the  "time  per 
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iteration  - basis  size"  curve  add  up  to  2.72,  which  is  the  exponent  of 
the  "time  - basis  size"  curve. 

We  also  kept  track  of  the  different  types  of  entering  columns. 

For  all  of  the  problem  groups,  a path  is  entered  into  the  basis  (as 
opposed  to  a slack  or  a surplus  variable)  in  roughly  90%  of  the 
iterations.  There  is  no  apparent  relation  to  the  size  of  the  problem. 

The  averages  for  different  problem  groups  vary  between  88%  and  95%. 

Concerning  the  individual  problems,  for  20  out  of  40  the  percentage  is 
above  90%  and  the  lowest  percentage  is  84%.  Note  these  percentages  are 
about  10%  higher  than  the  percentages  reported  in  the  first  part  of  the 
experiment.  The  reason  for  that  is  probably  the  modification  in  the 
column  pricing  sequence,  which  we  described  at  the  beginning  of  the 
second  part  of  the  experiment. 

The  percentage  of  the  CPU-time  that  is  used  for  pivot  operations 
and  for  SLP  both  go  down  as  the  problem  size  increases.  For  the  small 
problems,  row  operations  take  up  to  50%  of  the  CPU-time,  for  the  largest 
problem  set,  this  ratio  is  down  to  30%.  The  column  selection  procedure 
(SLP)  consistently  takes  less  time  than  the  pivot  operations.  The 
average  percentages  vary  from  38%  to  18%  as  we  increase  the  problem  size. 

For  larger  problems  only  one  half  of  the  total  CPU-time  is  accounted  for 
by  these  two  parts  of  the  program.  A major  time  consuming  segment  is 
sweeping  the  basis  inverse  every  50  iterations.  For  the  problems  with 
(m,n)  = (50,8),  this  correction  procedure  takes  between  47%  and  55%  of 
the  time.  This  segment  proves  to  be  useful  with  the  shortest  path  codes 
some  of  which  go  through  many  more  iterations  than  the  SLP  based  code  and 
hence  are  very  prone  to  roundoff  problems.  For  example,  the  code  D1 
requires  over  11,000  iterations  for  three  of  the  5 problems  with  30 


existing  and  5 new  facilities.  By  comparison,  in  the  second  part  of  the 
experiment,  the  SLP  based  code  goes  over  3000  iterations  in  only  4 out  of 
40  problems.  On  a single  problem  set  (with  50  existing  and  5 new 
facilities)  we  run  the  code  without  the  sweeping  segment.  In  this  set, 
there  are  3 problems  requiring  over  1400  iterations.  Without  the 
sweeping,  four  of  the  5 problems  are  solved  in  exactly  the  same  number  of 
iterations,  one  took  10  iterations  more  than  the  code  with  the  sweeping 
segment.  However,  this  is  very  limited  experience  to  draw  conclusions 
about  the  usefulness  of  the  segment.  We  used  it  for  insurance;  in  larger 
problems,  where  the  code  would  be  rquired  to  go  through  more  iterations, 
this  segment  may  be  more  useful. 

All  of  the  problems  studied  have  very  sparse  basis  inverse 

matrices,  the  sparsity  is  between  96%  and  over  99%.  Almost  all  of  the 

larger  problems  have  basis  inverses  that  are  over  99%  sparse.  We  believe 

this  is  a major  contributing  factor  to  the  low  exponent  of  the  time-size 

curve.  Earlier  we  discussed  that  the  average  time  per  iteration  grows  as 
1 3 

a function  of  q * , where  q is  the  basis  size.  However,  we  also  pointed 

2 

out  that  the  dominating  worst  case  order  is  0(q  ),  due  to  the  pivot 
operations.  Due  to  the  sparsity  of  B \ there  seems  to  be  a slight 
discrepancy  between  the  expected  and  the  experienced  growth  of  the 
computational  effort.  Let  us  compare  the  computational  times  required  by 
the  simplex  and  sweeping  segments.  Since  the  worst  case  efforts  are  the 
same  for  these  segments,  the  relative  amount  of  the  computational  effort 
for  these  procedures  should  be  fairly  constant  throughout  the  experiment. 
However,  for  the  small  problems  (such  as  (20,3),  (20,5),  (30,3)  and 
(40,3))  simplex  operations  take  about  2 times  as  much  time  as  the 
sweeping  operations,  while  for  large  problems  (such  as  (50,8),  (50,6)  and 
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(40,8))  this  ratio  is  reversed.  In  sweeping,  every  entry  of  the  basis 
inverse  is  examined.  Although  we  sweep  once  every  50  iterations,  for 
many  of  our  problems  sweeping  takes  more  effort  than  the  pivot 
operations.  The  empirical  results  indicate  that  the  relative  effort 
needed  for  simplex  operations  decrease  as  the  problem  size  increases.  We 
fit  curves  of  the  type  Y = a X to  the  average  total  time  consumed  by  the 
different  segments  of  the  code.  (We  average  the  time  consumptions  for 
the  corresponding  segment  over  a problem  set)  It  turns  out  that  the 
exponent  for  the  sweeping  segment  is  3.42,  whereas  the  exponent  for  the 
simplex  part  is  2.49;  the  SLP  segment  produces  the  lowest  exponent  with 
2.38.  Bearing  in  mind  that  these  parameters  are  for  the  "total  time" 
curves,  we  can  estimate  the  exponents  for  the  "average  time  per 
iteration"  curves  by  taking  the  exponent  of  the  "iteration  count  - size" 
curve  into  account.  Since  the  average  time  per  iteration  can  be 
expressed  as  the  total  time  divided  by  the  number  of  iterations,  to 
estimate  the  exponents  for  the  average  time  curves,  we  subtract  1.41 
(the  exponent  of  the  "iteration  count  - size"  curve)  from  the  exponents 
of  the  "total  time  for  segment  - size"  curves.  This  yields  exponents  of 
2.01,  1.08  and  0.97  for  the  sweeping,  simplex  and  SLP  segments 
respectively.  (We  also  fit  "average  time  per  iteration"  curves  for  each 
of  the  three  segments  and  arrived  at  the  same  exponents  as  above.)  The 
average  sweeping  time  per  iteration  grows  quadratically  with  the  size  of 
the  problem,  as  the  order  analysis  suggests.  The  average  SLP  time  per 
iteration  shows  a linear  growth;  consistent  with  the  linear  order  of  the 
SLP.  The  growth  exponent  of  the  average  simplex  time  per  iteration  is 
very  close  to  one.  (In  fact  the  one  standard  deviation  confidence 
interval  includes  one.)  This  provides  further  evidence  that  the  time 


consumed  by  the  pivot  operations  does  not  increase  drastically  with  the 
problem  size;  and  more  importantly,  if  the  sweeping  segment  is  taken  out, 
the  computational  time  per  iteration  will  grow  linearly  with  the  basis 
size  (provided  that  numerical  difficulties  will  not  develop). 

We  attempted  to  get  a mesure  for  the  average  number  of  columns 
priced  out  in  one  iteration  by  the  SLP  based  code.  We  counted  the  number 
of  new  facilities  successfully  located  by  SLP  before  discovering  a 
violated  path.  If  a set,  say  L,  of  new  facilities  is  successully  located 
than  all  paths  that  only  go  through  the  new  facilities  in  L correspond  to 
satisfied  path  conditions  and  hence,  to  columns  with  positive  reduced 
costs.  The  average  of  the  percentage  of  the  new  facilities  successfully 
located  at  an  iteration  is  around  20%.  For  different  problem  sizes,  the 
percentage  is  between  14%  and  29%;  there  is  no  apparent  trend  in  response - 
to  the  problem  size.  We  also  counted  the  number  of  violated  paths 
discovered  in  one  iteration.  Recall  that  SLP  checks  all  corresponding 
strings  upon  the  discovery  of  a violated  path,  in  an  effort  to  enter  the 
path  with  the  largest  violation.  The  average  number  of  violated  paths 
considered  per  iteration  is  between  7 and  22.  The  larger  number  of 
violated  paths  is  found  in  large  problems  (as  expected). 

The  number  of  iterations  in  the  simplex  method  is  not  very 
sensitive  to  the  number  of  columns  (variables)  of  the  problem. 

Futhermore,  the  solution  procedures  we  use  limit  the  number  of  columns  to 
be  considered  at  each  iteration  drastically.  Hence,  the  total  number  of 
the  columns  in  our  problems  is  not  very  relevant  to  the  effort  used. 
However,  it  is  interesting  to  note  that  our  largest  problem  (with  50 
existing  and  8 new  facilities)  has  in  excess  of  134  million  columns 
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(direct  paths).  The  number  of  simple  paths  in  the  network  BC  for  this 

20 

size  is  on  the  order  of  10 

To  summarize,  the  second  part  of  our  experiment  suggests  that 
there  is  a linear  relationship  between  the  natural  logarithm  of  the 
average  number  of  iterations  to  solve  a problem  and  the  natural  logarithm 
of  the  corresponding  basis  size,  q.  The  number  of  iterations  seems  to 
increase  as  a function  of  q^*^.  A similar  curve  describes  the 
relationsip  between  the  average  CPU-times  and  the  basis  size.  In  this 
case  the  exponent  is  2.7.  The  average  time  per  iteration  is  empirically 
determined  to  be  of  order  q * , lower  than  q , mostly  due  to  sparsity  of 
the  basis  inverse  matrix.  The  statistics  collected  indicate  that  the 
time  consumption  of  the  sweeping  segment  per  iteration  increases 
quadratically  with  the  problem  size,  whereas  the  time  consumption  for  the 
other  two  segments  (per  iteration)  increase  only  linearly.  The  sparsity 
is  above  99%  for  the  larger  problems.  About  90%  of  the  columns  entered 
correspond  to  paths.  The  column  selection  procedure  (SLP)  consistently 
takes  less  time  than  the  pivot  operations.  The  sweeping  time  starts  to 
dominate  as  the  problem  size  grows.  To  reiterate,  the  number  of 
iterations  and  the  computational  effort  increases  nonlinearly  with  the 
problem  size,  but  the  values  of  the  exponents  are  very  low.  Larger 
problems  may  be  solved  in  reasonable  amounts  of  time;  however  we  caution 
that,  as  in  any  regression  fit,  the  curve  is  only  valid  within  the 
experimented  range  of  the  independent  variable  (basis  size). 


CHAPTER  5 

COMPUTING  BOUNDS  FOR  LOCATION  PROBLEMS  ON  GENERAL  NETWORKS 
USING  LINEAR  PROGRAMMING 


We  now  turn  our  attention  from  trees  to  general,  connected  and 
undirected  (cyclic)  networks.  Our  purpose  is  to  consider  how  the  linear 
programming  model  described  in  Chapter  4 can  be  utilized  to  generate 
upper  and  lower  bounds  on  the  optimal  objective  function  value  of  a 
location  problem  on  a general  network.  We  also  report  the  results  of  our 
limited  computational  experimentation  with  the  procedures  described 
throughout  this  chapter.  We  do  not  intend  to  construct  an  exact  solution 
procedure  for  location  problems  on  general  networks.  Our  intent  is  to 
apply  the  methodology  of  Chapter  4 to  more  general  problems,  to  state 
some  basic  results  for  location  problems  on  general  networks,  and  to  lay 
the  foundation  for  further  research  in  this  potentially  very  fruitful 
area.  We  believe  the  most  important  contribution  of  this  chapter  is  the 
calculation  of  an  interval  including  the  optimal  objective  function  value 
for  the  problems  we  consider.  The  methods  we  use  for  computing  lower  and 
upper  bounds  are  new. 


5.1  Introduction 

The  idea  of  using  upper  and  lower  bounds  on  the  optimal  objective 
function  value  of  a problem  (which  is  not  "easy"  to  solve)  is  well  known 
and  widely  encountered  in  mathematical  programming.  Many  implicit 
enumeration  methods,  such  as  branch-and-bound , (Garfinkel  and  Nemhauser 
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(1972))  to  solve  discrete  optimization  problems,  some  nonlinear 
■ programming  algorithms  (Bazaraa  and  Shetty  (1979)),  Lagrangian  relaxation 
(Fisher  (1981))  and  subgradient  optimization  techniques  (Held,  Wolfe  and 
Crowder  (1974))  employ  upper  and  lower  bounds.  Usually,  the  tightness  of 
the  bounds  is  an  important  factor  affecting  the  utility  of  such  solution 
procedures. 

The  literature  on  location  problems  on  general  networks  is  very 
extensive;  different  techniques  have  been  suggested  for  a variety  of 
problems.  Handler  and  Mirchandani  (1979)  classify  the  solution 
techniques  used  to  solve  network  location  problems  in  five  main  groups; 
enumeration  methods,  graph  theoretic  approaches,  heuristics,  primal-based 
mathematical  programming  and  dual-based  mathematical  programming. 
Concentrating  on  the  well-known  and  widely  studied  median  problem,  we 
give  examples  from  each  category.  Hakimi's  (1965)  1-median  algorithm  is 
an  example  of  an  enumeration  method.  Most  graph  theoretical  approaches, 
such  as  Goldman's  1— median  algorithm  (1971)  and  Kariv  and  Hakimi's 
(1976b)  p-median  algorithm,  have  been  successful  only  when  the  underlying 
network  is  a tree. 

Heuristic  procedures  are  based  either  on  intuitive  notions 
(Maranzana  (1964),  Kuehn  and  Hamburger  (1963),  Teitz  and  Bart  (1968))  or 
on  approximate  solutions  to  mathematical  programming  formulations 
(Jarvinen,  Rajala,  Sinervo  (1972)).  Cornuejols,  Fisher  and  Nemhauser 
(1977),  Garfinkel,  Neebe  and  Rao  (1974)  and  Khumawala,  Neebe  and 
Dannenbring  (1974)  present  computational  results  on  heuristic  procedures. 
Some  heuristic  procedures  have  reportedly  performed  very  well  and  have 
produced  either  optimal  or  near-optimal  solutions  with  consistency.  The 
interest  in  heuristics  is  due  to  the  high  complexity  of  the  exact 


145 


solution  procedures.  The  p-raedian  problem  is  NP-complete  (Kariv  and 
Hakimi  (1979b)).  A heuristic  solution,  which  is  usually  obtained  with 
little  computational  effort  (relative  to  the  exact  solution),  may  provide 
a good  upper  bound  on  the  optimal  objective  function  value.  The  upper 
bound  in  turn  can  be  used  in  an  exact  solution  procedure.  Handler  and 
Mirchandani  suggest  that  the  maximum  error  of  a heuristic  solution  can  be 
checked  using  a lower  bound  on  the  objective  function  value,  which  is 
often  derived  from  the  linear  programming  relaxation  of  an  integer 
programming  problem. 

Since  enumeration  algorithms  are  limited  to  small  problems  and 
graph  theoretical  approaches  have  been  limited  to  tree  networks,  all 
exact  solution  procedures  that  we  know  of  for  the  p— median  problem  on  a 
general  network  fall  under  the  general  category  of  mathematical 
programming . We  can  list  Khumawala's  (1972)  branch-and  bound  procedure, 
and  the  LP  relaxations  by  Swain  (1974),  Schrage  (1975)  and  Garfinkel, 
Neebe  and  Rao  (1974)  as  examples  of  primal-based  procedures.  Diehr 
(1972),  Narula,  Ogbu  and  Samuelson  (1977)  and  Cornuejols,  Fisher  and 
Nemhauser  (1977)  applied  Lagrangian  relaxation  (a  dual— based  procedure) 
to  the  p-median  problem,  using  different  relaxations.  Cornuejols  et  al. 
suggest  first  using  a heuristic  to  obtain  a good  solution,  then  improving 
the  solution  using  subgradient  optimization  and  finally  performing 
branch-and-bound  (if  necessary)  to  find  the  optimal  solution. 

The  p-center  problem  is  another  problem  which  attracted 
considerable  attention  in  the  literature.  Halpern  and  Maimon  (1982) 
suggest  a general  framework  for  the  p-center  algorithms  on  general 
networks  and  show  that  the  algorithms  by  Minieka  (1970),  Handler  (1979), 
Kariv  and  Hakimi  (1979a)  and  Christofides  (1975)  fit  into  this  framework. 


All  of  these  algorithms  involve  successive  solutions  of  covering 
problems.  Halpern  and  Maimon  point  out  that  this  problem  is  NP-complete 
(Kariv  and  Hakimi  (1979a),  Nemhauser  and  Sheu  (1979))  and  state  that  if 
major  improvements  for  the  solution  of  this  problem  can  be  developed, 
they  need  to  be  heuristics.  They  suggest  employing  heuristics  in  order 
to  help  identify  "tight"  bounds  on  the  optimal  objective  function  value. 

We  solve  a restriction  and  a relaxation  of  the  general  network 
problem  to  achieve  an  upper  and  a lower  bound  on  the  optimal  objective 
function  value.  Hence  the  bounds  generated  by  the  problems  we  suggest  in 
this  chapter  can  be  used  in  conjunction  with  a solution  technique  that  is 
based  on  mathematical  programming.  Furthermore,  since  the  restriction  of 
the  problem  produces  a feasible  solution,  the  solution  we  obtain  from  the 
restriction  can  be  viewed  as  a heuristic  solution  for  the  problem  on  the 
general  network.  -More  importantly,  we  can  derive  upper  and  lower  bounds 
for  some  problems  which  have  never  been  studied  before,  such  as  many 
continuous  location  problems  with  distance  constraints  on  general 
networks . 

Although  we  listed  some  examples  of  earlier  research  dealing  with 
related  problems,  we  point  out  that  there  is  a significant  difference 
between  most  of  the  solution  procedures  suggested  for  the  median  and  the 
center  problems  and  our  solution  procedure.  The  median  and  the  center 
problems  are  discrete  problems,  and  different  relaxations  of  the  integer 
programming  models  are  generally  used  to  achieve  lower  bounds.  We  are 
not  considering  discrete  problems,  hence  we  need  new  ways  of  computing 
the  bounds.  The  solution  techniques  we  use  provide  us  with  bounds  on 
continuous  location  problems. 
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We  derive  the  upper  bound  by  solving  the  problem  on  a spanning 
tree(s)  of  the  general  network.  To  the  best  of  our  knowledge,  there  is 
no  literature  on  solving  (exactly  or  approximately)  a location  problem  on 
a general  network  by  solving  a series  of  problems  on  the  spanning  trees 
of  the  network.  However  in  other  areas  of  optimization,  there  are 
examples  of  attacking  "hard"  problems  by  solving  a sequence  of  "easy" 
problems,  such  as  using  a sequence  of  linear  programming  problems  to 
optimize  a nonlinear  objective  function  or  to  solve  an  integer 
programming  problem. 


5.2  Generating  the  Bounds 

We  first  define  our  notation.  We  denote  the  underlying  general 
network  by  G and  a spanning  tree  of  G by  T.  A solution  to  the  problem  on 
G is  denoted  by  X^,  whereas  a solution  to  the  problem  on  T is  denoted  by 
Xr  We  use  D(X)  to  denote  the  vector  of  distances  (between  existing  and 
new  facilities  and  between  pairs  of  new  facilities).  To  differentiate 
between  the  distance  vectors  for  networks  G and  T we  use  the  notation 
D(X:G)  and  D(X:T)  respectively.  We  use  d as  the  vector  of  distances  (d^ 
in  T and  d^  in  G)  between  pairs  of  existing  facilities  and  d(i,j)  as  the 
distance  between  any  two  points  i and  j , and  b to  denote  the 
corresponding  upper  bounds.  The  objective  function,  which  is  assumed  to 
be  nondecreasing  in  D,  is  denoted  by  f.  We  use  f(D(X:T))  to  denote  the 
evaluation  of  some  solution  X using  the  distance  matrix  of  T;  f(D(X:G)) 
is  defined  similarly.  The  problem  we  study  can  be  written  as: 

(PG)  min  f (D(X:G)) 

s.t.  D(X:G)  <_  b, 


X e G. 
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We  denote  the  related  problem  of  minimizing  f(D(X:T))  on  some 
spanning  tree  T of  G,  subject  to  the  same  constraints,  by  (PT).  While 
the  function  f for  the  two  problems  is  the  same,  regarding  the  distance 
between  two  given  points  u and  v on  the  network,  we  obviously  have 
d(u,v:G)  <_  d(u,v:T).  Finding  d(u,v:T)  is  a restriction  of  the 
minimization  problem  of  finding  d(u,v:G). 

We  note  it  is  possible  for  (PG)  to  be  feasible  and  for  (PT)  to  be 
infeasible,  depending  on  the  constraint  set  and  the  choice  of  the 
spanning  tree  T.  The  problem  (PT)  is  a restriction  of  (PG)  and 
feasibility  of  (PG)  does  not  guarantee  feasibility  of  (PT)  in  general. 
However,  if  (PG)  has  no  constraints  between  pairs  of  existing  and  new 
facilities,  then  (PT)  is  guaranteed  to  be  feasible.  Throughout  this 
chapter  we  assume  that  (PT)  is  feasible  for  some  spanning  tree  of  G. 

5}*  -J, 

Lemma  5.1:  If  solves  (PG)  and  X^  solves  (PT),  then  we  have 

f(D(XQ*:G))  < f(D(XT*:G)  < f(D(XT*:T)) . 

Proof : Since  XQ*  is  optimal  to  (PG),  f(D(XG~:G))  < f(D(XT*:G)). 

For  any  solution  X,  f(D(X:G))  _<  f(D(X:T)),  since  D(X:G)  < D(X:T)  and  f is 
a nondecreasing  function  of  the  distance. [] 

Note  (PT)  is  a restriction  of  (PG)  and  thus  (intuitively)  the 
optimal  objective  function  value  of  (PT)  is  an  upper  bound  on  the  optimal 
objective  function  value  of  (PG).  The  above  result  identifies  another 
(possibly  sharper)  upper  bound  on  f(D(Xg*:G)),  namely  f (Dtx" :G) ) . 

Recall  in  Chapter  4 we  considered  the  linear  programming  problem 
of  minimizing  f(Z),  subject  to  constraints  D(X)  <.  Z <_  b.  We  then  used 
the  separation  conditions  to  replace  D(X)  <_  Z by  AZ  >_  d,  where  A is  a 
(0-1)  arc-path  matrix.  This  is  a valid  substitution  since  the  constraint 
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sets  D(X)  <_  Z and  AZ  _>  d are  equivalent  if  the  underlying  network  is  a 
tree,  as  proven  by  Francis,  Lowe  and  Ratliff  (1978). 

The  general  problem  considered  in  this  chapter  is  the  same  as  in 

Chapter  4,  but  now  the  underlying  network  is  a cyclic  network  instead  of 

a tree.  We  denote  the  problem  on  the  general  network  by  (PG),  the 

equivalent  optimization  problem  by  (PZ)  and  the  problem  where  the 

constraint  set  D(X)  < Z of  problem  (PZ)  is  replaced  by  AZ  _>  d by  (PLB). 

Denoting  the  optimal  solutions  to  (PZ)  and  (PLB)  by  t7  and  ZT _ 

Lb 

respectively,  we  have  the  following  result. 

Lemma  5.2:  f(ZLg)  < f(Z*)  = f(D(Xg*:G)). 

Proof : The  proof  is  based  on  the  fact  that  the  separation 

conditions  are  only  necessary  conditions  for  feasibility  if  the 
underlying  network  is  cyclic,  as  stated  by  Francis  et  al.  The 
consistency  of  D(X:G)  <_  Z implies  the  consistency  of  AZ  > dp.  The  proof 
of  this  by  Francis  et  al.  uses  only  distance  symmetry  and  the  triangle 
inequality.  Thus  by  replacing  D(X:G)  Z by  AZ  >_  d^,  we  get  a relaxation 

•x. 

of  the  problem,  and  hence  f(Z^g)  <_  f(Z  ).  Note  the  equality  in  the  lemma 
is  due  to  the  equivalence  of  (PG)  and  (PZ),  which  is  based  on  the 
development  in  Chapter  4 using  the  monotonicity  result. [] 

We  can  solve  the  problem  (PLB)  using  the  column  generation 
technique,  and  obtain  a lower  bound  on  the  optimal  objective  function 
value  of  (PG).  Of  course,  we  cannot  use  SLP  for  column  pricing,  since 
SLP  is  only  defined  if  the  network  is  a tree.  However  we  can  use  one  of 
the  shortest  path  algorithms  for  column  generation. 

To  summarize  this  section,  we  can  compute  upper  and  lower  bounds 
for  the  problem  (PG)  using  the  procedures  introduced  in  Chapter  4.  The 
solution  on  a spanning  tree  of  G is  a feasible  solution  to  (PG),  and  the 
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difference  between  the  bounds  is  a measure  of  the  maximum  deviation  of 
the  objective  function  value  of  the  feasible  solution  from  the  optimal 
objective  function  value. 


5.3  Some  Theoretical  Results 


In  this  section  we  state  three  results  that  relate  the  solution  of 

the  problem  (PG)  to  the  solution  of  the  problem  on  a spanning  tree  of  G. 

Dearing  and  Francis  (1974b)  consider  the  following  single  facility 

minimax  problem  on  G:  min  ( max  { w^x.v^  + g_[  : 1 <.  i <.  m }},  where 

wVs  are  "weights"  and  g^’s  are  "addends".  Define  the  weighted  diameter 

of  a tree  as  the  maximum  of  { (w. w .d(v. ,v  .)  + w.e.  + w .g  . )/(w.+w  .)  : 

i j v i y i6j  v i y 

1 <,  i <.  j <_  m } . They  show  that  the  problem  of  finding  a spanning  tree 
of  G with  minimum  weighted  diameter  is  an  equivalent  problem  to  the 
problem  they  study.  Their  result  (Lemma  3 in  Dearing  and  Francis 
(1974b))  can  readily  be  generalized  to  any  single  facility  network 
location  problem,  where  the  objective  function  is  an  increasing  function 
of  shortest  distances  between  new  and  existing  facilities.  Using  our 
notation  we  state  the  result;  however  we  leave  out  the  proof  since  it  is 
essentially  the  same  as  the  proof  of  Lemma  3 in  Dearing  and  Francis 


(1974b). 

Lemma  5.3:  Assume  n = 1.  Suppose  min  f(D(X:G))  = f(D(X„  :G)). 

Then  there  exists  some  spanning  tree  T of  G with 

min  f (D(X:T) ) = f(D(XT'':T))  such  that  f(D(XG*:G))  = f(D(XT*:T)) 

vU  -u 

*T"  *T- 

and  XT  = Xq  ■ 

Note  this  result  states  that  there  exists  a spanning  tree  T of  G, 

which  produces  the  same  optimal  solution  as  (PG).  A spanning  tree  with 

* 

this  property  is  the  shortest  path  spanning  tree  rooted  at  Xp  ; the  proof 

(j 
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*T* 

uses  the  equality  of  the  distances  between  and  all  other  points  of 
the  network  on  this  spanning  tree  and  G. 

For  a multifacility  problem  if  we  construct  a shortest  path 
spanning  tree  rooted  at  each  of  the  optimal  new  facility  locations  on  G, 
then  the  union  of  these  spanning  trees  may  not  be  a spanning  tree,  unless 
all  of  the  new  facilities  are  located  at  the  same  point.  Hence  this 
result  cannot  be  easily  generalized  to  the  multifacility  case. 

We  next  state  a sufficient  condition  regarding  the  solution  of  the 
multifacility  problem  on  G and  on  some  spanning  tree  T of  G. 

Theorem  5.1:  Assume  n £ 1.  If  there  exists  a spanning  tree  T of 
G,  such  that  d(v^,Vj:T)  = d(v^,Vj:G)  for  all  i and  j,  then 
f(D(XG*:G))  = f(D(XT*:T)). 

Proof : The  problem  (PLB),  which  is  the  relaxation  of  the  problem 

(PZ)  and  the  problem  on  the  spanning  tree  T of  G,  (PUB),  which  is  a 
restriction  of  (PZ) , can  be  written  as  follows: 

(PLB)  min  f(Z)  (PUB)  min  f(Z) 

st.  AZ  >_  dg,  st.  AZ  >_  d,p, 

0 < Z < b.  0 _<  Z _<  b. 

Recall  the  problem  (PLB)  provides  a lower  bound  for  the  problem 
(PZ)  (and  thus  for  (PG))  and  the  problem  (PUB)  provides  an  upper  bound 
and  a feasible  solution  for  problem  (PZ)  (and  thus  for  (PG)).  Note  for 
d^  = d^  the  problems  (PLB)  and  (PUB)  are  exactly  the  same.  Hence,  the 
optimal  solution  to  (PUB)  will  attain  the  lower  bound  provided  by  (PLB) 
and  the  problem  on  the  spanning  tree  T solves  the  problem  on  G.[] 

We  now  state  a result  regarding  a special  spanning  tree,  the 


shortest  spanning  tree. 


Theorem  5.2:  If  there  exists  a spanning  tree  T of  G,  such  that 


d(vi,vj:T)  = d(v^,Vj:G)  for  all  vertices  i and  j,  then  T is  a shortest 
spanning  tree. 

Proof : Let  T'  be  any  spanning  tree  of  G.  Clearly,  for  all  i and 

j»  d ( , v j : G)  <_  d(v_^ , v.  :T'  ) . Combining  this  inequality  with  our 
assumption,  we  also  have 

d(v^,Vj:T)  <_  d(v^,Vj :T' ) , for  all  i and  j.  (1) 

f 

Now  let  L(T)  and  L(T')  denote  the  sum  of  all  arc  lengths  in  T and  T 
respectively.  We  have 

L(T')  = i { d(v_^,vq.:T')  : (v^,vq.)  an  arc  in  T } 

_>  Z { d(v^,vq.:T)  : (v^,v.)  an  arc  in  T },  (2) 

where  inequality  (2)  follows  from  inequality  (1). 

Consider  any  arc  (vi>Vj)  in  T'.  Assume  that  the  simple  path  from 
to  Vj  in  T containts  the  arc  (v  ,v  ),  with  possibly  i = p or  j = q or 
both.  Consequently  we  have 

d(v_.,v  :T)  >_  d(v  ,v  :T)  for  (v  ,v  ) in  T (3) 

J r H r H 

Now  consider  the  sum  on  the  right  hand  side  of  inequality  (2).  The 

inequality  (3)  holds  for  every  term  of  that  sum,  and  furthermore  that  sum 

contains  the  term  d(v  ,v  :T)  for  every  arc  (v  ,v  ) in  T at  least  once. 

p q P q 

Hence  we  have 

Z { dCv^.VjiT)  : (vi?v  ) an  arc  in  T'  } 

> Z { d(vp,vq:T)  : (vp,vq)  in  T } = L(T).  (4) 

Combining  inequalities  (2)  and  (4)  we  have  L(T')  >_  L(T) , so  T is  a 
shortest  spanning  tree.[] 

As  a result  of  this  theorem,  to  check  to  see  if  there  exists  a 
tree  T that  has  the  same  distance  matrix  for  the  distances  between  the 
vertices  as  G does,  we  only  need  to  check  shortest  spanning  trees  of  G. 
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If  no  SST  has  a distance  matrix  that  is  the  same  as  the  distance  matrix 
of  G,  then  no  other  spanning  tree  does,  by  Theorem  5.2.  If  some  SST  does 
satisfy  the  condition  of  Theorem  5.1,  then  solving  the  problem  on  that 
SST  will  solve  the  problem  on  G;  all  arcs  that  are  not  in  SST  are 
redundant,  since  for  arc  (v^.v^)  that  is  not  in  SST,  the  arc  (vi>vj) 
cannot  be  shorter  than  the  length  of  the  path  P(v_^,Vj)  in  the  SST.  We 
remark  that  Theorems  5.1  and  5. 2. may  be  of  limited  usefulness,  since  for 
an  arbitrary  graph  G it  is  unlikely  that  G will  have  a spanning  tree  T 
for  which  d(v^,v.:T)  = d(vi,Vj:G). 

Before  we  move  on  to  algorithmic  considerations,  we  draw  the 
following  set  diagram,  which  represents  the  relations  between  the 
solutions  of  the  problem  on  G and  on  some  spanning  tree  T of  G.  We  then 
give  simple  examples  to  demonstrate  the  relationships  between  the  problem 
on  G and  the  problem  on  T,  some  spanning  tree  of  G.  Denote  the  set  of 

vt. 

spanning  trees  where  minimizes  f(D(X:T))  and  f(D(X:G))  by  SAME-X,  the 
set  of  spanning  trees  where  T and  G have  the  same  distance  matrix  by 
SAME-D  and  finally  the  set  of  spanning  trees  where 

vU  -A0 

f(D(X,p":T))  = f(D(Xrp' :G))  by  SAME-F.  Certainly  this  is  not  an  exhaustive 
representation  of  all  spanning  trees,  however  the  spanning  trees  in  sets 
SAME-X,  SAME-D  and  SAME-F  are  potentially  useful  in  solving  the  problem 
on  G. 


1 


3 


Theorem  5.1  states  that  if  T is  in  SAME-D,  then  T is  in  SAME-X  and 
in  SAME-F.  We  denote  the  region  where  T is  in  SAME-X  but  not  in  SAME-F 
by  region  1 , the  region  where  T is  in  SAME-X  and  SAME-F  but  not  in  SAME-D 
by  region  2 and  the  region  where  T is  in  SAME-F  but  not  in  SAME-X  by 
region  3. 

Consider  the  following  1-center  problem,  where  all  weights  are 
equal  to  one  and  the  arc  lengths  are  marked  along  the  arcs.  Note  for 
this  problem  no  spanning  tree  has  the  same  distance  matrix  as  G,  hence 
set  SAME-D  is  empty.  The  optimal  1-center  for  this  problem,  Xr " is 
halfway  between  vertices  3 and  4. 

G : 


Construct  the  spanning  tree  T by  deleting  the  arcs  (1,3)  and  (4,6) 

•fa 

from  G.  The  optimal  1-center  X,p  is  again  halfway  between  vertices  3 and 
4,  however  f(D(X^  :T))  = 12  which  is  greater  than  f(D(X^,  :G)).  Hence  for 
this  problem  region  1 is  not  empty. 

T : 


5 


5 
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Now  consider  deleting  arcs  (1,2)  and  (5,6)  from  G to  get  the 
spanning  tree  S of  G.  The  optimal  1-center  for  S is  again  halfway 
between  vertices  3 and  4.  Furthermore  f (D(X  '":S))  = 10  = f(D(Xc:G)). 

O b 

Thus  spanning  tree  S belongs  to  region  2. 

S : 


We  construct  spanning  tree  R by  deleting  arcs  (1,3)  and  (5,6)  from 
G.  The  optimal  1-center  of  R is  between  vertices  3 and  4,  4 units  away 
from  vertex  3.  We  have  f(D(XR*:R))  = 11  = f(D(XR'":G))  > f (D(XG“:G) ) . 
Spanning  tree  R belongs  to  region  3. 

R : 


The  example  problem  demonstrates  that  regions  1,  2 and  3 can  be 
nonempty . 

The  spanning  tree(s)  in  set  SAME-X  are  interesting,  since  they 
produce  the  same  optimal  locations  for  the  new  facilities  as  G.  Above  we 
have  given  an  example  of  the  set  SAME-X  having  at  least  one  member.  An 
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important  question  is  whether  the  set  SAME-X  is  nonempty  for  every 
problem.  If  the  answer  is  affirmative,  then  efforts  should  be  directed 
towards  finding  a member  of  the  set  SAME-X  to  solve  a given  problem  on  a 
general  network.  We  give  a simple  example  which  demonstrates  that  the 
set  SAME-X  may  be  empty,  depending  on  the  problem.  Imagine  a three- 
facility  problem  for  a graph  which  is  a cycle  with  three  vertices  and 
three  arcs.  Suppose  the  unique  optimal  solution  of  the  problem,  X ^ is 
such  that  each  new  facility  is  located  on  a different  arc.  Since  any 
spanning  tree  of  this  graph  will  only  contain  2 arcs,  clearly  no  spanning 
tree  will  yield  X . 

We  remark  that  even  if  we  can  find  a spanning  tree  (which  is  not 
shortest)  that  yields  the  optimal  solution  on  G,  it  would  be  hard  to 
verify  the  optimality  of  this  solution  on  G. 

5.4  Algorithmic  Considerations 

We  discussed  in  Section  5.2  how  we  can  generate  upper  and  lower 
bounds  on  the  optimal  objective  function  value  of  the  problem  on  G.  To 
generate  upper  bounds  we  solve  the  problem  on  some  spanning  tree  T of  G. 
We  can  use  many  different  spanning  trees;  G may  have  0(m! ) distinct 
spanning  trees,  depending  on  the  density  of  the  network.  Depending  on 
which  spanning  tree  is  used,  we  have  a different  upper-bounding  problem. 
We  now  list  several  techniques  to  generate  a spanning  tree  to  be  used  in 
the  restriction  problem.  We  use  three-letter  acronyms  for  the  different 
techniques  we  suggest. 

In  the  previous  section  we  stated  a condition  under  which  a 
shortest  spanning  tree  will  provide  the  optimal  solution  to  the  problem 
on  G.  Furthermore,  by  definition,  a shortest  spanning  tree  includes  the 


set  of  arcs  with  the  least  total  length,  that  minimally  connects  all 
vertices  of  G.  Since  most  objective  functions  of  network  location 
problems  involve  minimizing  some  function  of  the  distances,  the  shortest 
spanning  tree,  denoted  by  SST,  seems  to  be  a logical  choice  for  the 
restriction  problem.  To  generate  a shortest  spanning  tree  of  G we  use 
Kruskal's  algorithm  (1956).  In  an  effort  to  evaluate  the  importance  of 
the  selected  spanning  tree  we  also  solve  the  problem  on  the  longest 
spanning  tree  (LST)  and  on  several  randomly  generated  spanning  trees 
(RST)  of  G.  Comparing  the  optimal  objective  function  values  of  the 
solutions  from  SST,  LST  and  RST  may  provide  some  useful  information 
regarding  the  selection  of  the  spanning  tree  for  the  restriction  problem. 
To  generate  longest  and  random  spanning  trees  we  use  slight  modifications 
of  Kruskal's  algorithm. 

To  get  the  lower  bound,  we  solve  the  problem  (PLB)  using  column 
generation  with  Floyd's  shortest  path  algorithm.  We  use  the  version  that 
limits  the  entering  paths  to  direct  paths  due  to  the  superior 
computational  performance  as  reported  in  Section  4.4.  Please  note  that 
we  do  not  need  to  start  solving  this  problem  with  an  initial  basis 
inverse  that  is  equal  to  an  identity  matrix.  The  only  difference  between 
the  linear  programs  (PUB)  and  (PLB)  is  in  the  distance  data.  Since  in 
the  dual  problem  the  distances  correspond  to  the  objective  function 
coefficients,  we  can  use  the  optimal  basis  of  the  problem  (PUB)  as  an 
initial  basis  for  (PLB).  In  order  to  accomplish  this  we  need  to  keep 
track  of  the  costs  of  the  basic  variables  (c^)  and  also  store  a Boolean 
variable  that  indicates  whether  the  basic  variable  i corresponds  to  a 
path  or  not.  Suppose  the  basic  variable  i in  the  optimal  solution  of 
(PUB)  corresponds  to  a path  between  the  vertices  j and  k of  the  network 
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G.  For  problem  (PUB),  the  cost  of  this  basic  variable  is  equal  to 
d(vj,vk:T).  To  initiate  (PLB),  we  need  to  change  the  cost  of  this  basic 
varible  to  d(Vj,vk:G).  After  making  all  the  necessary  changes  in  the 
cost  coefficients,  we  can  recalculate  c^B  ^ and  start  solving  the  problem 
on  G using  the  distance  data  of  G for  the  separation  condition  checks. 
Please  note  that  we  are  in  effect  reducing  some  of  the  "profit" 
coefficients  (dCv^.v^G)  j<  d(Vj.,vk:T)  for  all  j and  k)  in  an  optimal 
solution  of  a maximization  problem.  Thus  the  optimal  solution  may 
change.  Also  note  that  we  can  use  this  "warm  start"  technique  for 
solving  the  problem  on  several  spanning  trees  of  G.  Only  for  the  first 
spanning  tree  do  we  need  to  start  with  an  identity  basis.  For 
consecutive  problems  we  can  use  the  optimal  basis  of  a problem  solved 
previously.  Furthermore,  we  can  use  this  computational  technique  to 
solve  problems  with  the  same  weight  data  but  different  upper  bounds  on 
the  distances  between  pairs  of  facilities.  Again,  the  upper  bounds  on 
distances  are  cost  coefficients  of  the  dual  problem. 

This  "warm  start"  method  outlined  above  may  result  in  considerable 
savings  in  computational  effort;  however  it  also  could  contribute  to 
roundoff  error.  Since  our  experimentation  is  limited  to  small  problems, 
we  do  not  use  this  computational  shortcut;  however  it  is  advisable  to 
implement  it  when  solving  larger  problems. 

We  have  described  how  we  can  find  upper  and  lower  bounds  for  the 
problem  (PG)  in  this  section.  We  suggested  three  methods  (SST,  LST,  RST) 
of  finding  a feasible  solution  and  hence  computing  an  upper  bound.  We 
now  descibe  our  computational  experience  with  these  methods. 
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5.5  Computational  Experience 

As  we  pointed  out  in  the  introduction,  the  experimentation  in  this 
section  is  limited,  and  the  main  purpose  is  to  evaluate  some  bounds 
numerically  on  a set  of  problems.  We  use  the  codes  developed  for  the 
experiments  in  the  previous  chapter.  The  only  new  code  necessary  for 
this  experiment  is  a code  that  generates  spanning  trees  (shortest, 
longest  and  random) . We  combine  the  spanning  tree  generating  code  with 
the  column  generation  codes  via  SLP  and  the  direct  paths  version  of 
Floyd's  shortest  path  algorithm.  In  one  run,  the  code  solves  restriction 
problems  on  several  spanning  trees  (we  use  the  shortest,  the  longest  and 
eight  random  spanning  trees  per  problem),  evaluates  the  solutions  on  G 
and  selects  the  lowest  of  the  upper  bounds  generated.  The  upper  bound  is 
then  compared  to  the  lower  bound  provided  by  the  solution  of  the 
relaxation  problem,  and  the  percentage  difference  is  computed. 

We  first  give  a brief  overview  of  the  experiment,  which  consists 
of  three  main  parts.  In  the  first  part  our  main  objective  is  to  evaluate 
the  upper  and  lower  bounds  achieved  using  the  techniques  described  in 
this  chapter.  We  solve  problems  of  different  sizes,  collect  statistics 
regarding  the  bounds,  and  identify  the  spanning  trees  that  yield  the 
tightest  upper  bounds.  In  the  second  part,  we  study  the  effect  of  the 
network  density  on  the  bounds.  We  solve  a series  of  problems  on  networks 
with  different  sparsities.  Sparse  networks  are  expected  to  yield  closer 
bounds.  In  part  two  we  also  solve  some  1-median  problems  to  evaluate  the 
quality  of  the  bounds.  Finally,  in  the  third  part  we  use  two  actual 
networks,  the  road  network  of  two  Canadian  provinces,  and  the  railroad 


network  of  Western  Canada.  All  of  the  networks  we  use  are  planar,  since 
most  applications  (for  example  road  networks)  would  involve  such 
networks. 

In  all  three  parts,  we  use  shortest  spanning  trees  (SST),  longest 
spanning  trees  (LST)  and  eight  random  spanning  trees  (RST)  per  problem  to 
compute  the  upper  bounds.  To  get  the  shortest  spanning  tree  we  use 
Minieka's  (1979)  implementation  of  Kruskal's  (1956)  algorithm.  The 
algorithm  first  constructs  an  arc-list  in  increasing  order  of  the 
distances.  Tracing  the  arc  list  from  the  top  to  the  bottom  using  the 
spanning  tree  algorithm  yields  a shortest  spanning  tree,  whereas  tracing 
it  from  the  bottom  to  the  top  yields  a longest  spanning  tree.  We  now 
describe  how  we  obtain  a random  spanning  tree.  We  start  with  an  arc 
list;  suppose  the  number  of  arcs  in  the  list  is  k.  We  generate  a random 
integer,  say  r,  between  1 and  k.  We  delete  the  r^  arc  from  the  arc  list 
and  use  it  in  the  spanning  tree  algorithm.  Our  arc  list  now  contains 
only  (k-1)  arcs,  hence  we  generate  a random  integer  between  1 and  (k-1) 
and  proceed  in  the  same  fashion,  until  we  complete  the  spanning  tree. 

Throughout  this  experiment  we  solve  a total  of  50  minisum  problems 
where  the  objective  function  contains  only  interactions  between  the 
existing  and  the  new  facilities,  and  there  are  upper  bounds  on  the 
distances  between  pairs  of  new  facilities.  We  consider  problems  with  20 
to  40  existing  facilities  and  2 to  3 new  facilities.  The  weights  in  all 
of  the  problems  are  "zoned"  (as  in  Chapters  3 and  4)  and  in  each  problem 
at  least  one  of  the  distance  constraints  is  binding  in  the  best  feasible 
solution  generated.  We  now  describe  each  part  in  more  detail  and  report 
our  findings. 
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In  the  first  part,  we  use  3 networks  with  20  vertices  (G^,  G0,  G^ 
with  27,  29  and  31  arcs  respectively)  and  3 networks  with  30  vertices 
(Np  N2  and  N^,  with  46,  48  and  50  arcs  respectively).  We  constructed 
these  networks  manually,  with  an  effort  to  create  networks  with  differing 
structures.  On  these  networks  we  solve  two  and  three  facility  problems. 
The  following  table  summarizes  our  experimental  design  in  part  one. 

Table  5.1:  Experimental  design  for  the  first  part  of  the  experiment. 

The  numbers  in  the  boxes  indicate  the  problem  numbers  for  the 
corresponding  problem  size. 


G1 

m = 20 

g2 

G3 

N1 

m = 30 

n2 

N3 

n = 2 
n = 3 

1,2,3 

1,2,3 

4,5,6 

4,5,6 

7,8,9 

7,8,9 

1,2,3 

1,2,3 

4,5,6 

4,5,6 

7,8,9 

7,8,9 

Hence  we  have  four  different  problem  sets,  with  (m,n)  = (20,2), 
(20,3),  (30,2)  arid  (30,3).  For  each  network  we  use  three  different  sets 
of  weights  and  upper  bounds.  Thus  we  solve  a total  of  9 problems  (all 
combinations  of  the  three  networks  and  the  three  sets  of  weights)  for 
every  problem  size.  The  networks  we  use  are  shown  in  Figures  5.1  through 
5.6,  with  the  distances.  Among  the  problems  with  m = 20,  problems  1,  2 
and  3 are  solved  on  G^,  4,  5 and  6 are  solved  on  G2  and  7,  8,  and  9 are 

solved  on  G^.  Among  the  problems  with  m = 30,  problems  1,  2 and  3 are 

solved  on  N^,  4,  5 and  6 are  solved  on  ^ and  7,  8,  and  9 are  solved  on 

N^.  The  basic  purpose  of  this  part  is  to  apply  the  different  bounding 

methods  to  several  problems  and  judge  empirically  how  tight  the  generated 
bounds  are. 

In  this  section  we  use  the  term  "gap"  to  denote  the  percentage 
difference  between  the  lowest  upper  bound  generated  by  the  restriction 
problems  solved  and  the  lower  bound  of  a problem.  To  get  an  upper  bound, 
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Figure  5.1:  The  network  G1 , used  for  problems  1-3  (with  20  existing 

facilities)  in  the  first  part  of  the  experiment. 
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Figure  5.2:  The  network  G2,  used  for  problems  4-6  (with  20  existing 

facilities)  in  the  first  part  of  the  experiment. 
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Figure  5.3:  The  network  G3,  used  for  problems  7-9  (with  20  existing 

facilities)  in  the  first  part  of  the  experiment. 
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Figure  5.4:  The  network  N1 , used  for  problems  1-3  (with  30  existing 

facilities)  in  the  first  part  of  the  experiment. 
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Figure  5.5:  The  network  N2,  used  for  problems  4-6  (with  30  existing 

facilities)  in  the  first  part  of  the  experiment. 
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Figure  5.6:  The  network  N3,  used  for  problems  7-9  (with  30  existing 

facilities)  in  the  first  part  of  the  experiment. 


we  solve  the  problem  on  T,  a spanning  tree  of  the  original  network  G and 
then  evaluate  the  solution  using  the  distance  matrix  of  G.  The 
evaluation  of  the  solution  on  G improves  the  upper  bound  produced  by  the 
spanning  tree  problem  drastically;  in  some  of  the  problems,  f(X,j,:G)  is 
one  half  of  f(XT:T).  In  Tables  5.2  and  5.3  we  list  the  gap  values  for 
the  36  problems  we  experimented  with,  using  f(D(X,j,:T)  and  f(D(X^:G) 
respectively.  Please  note  that  all  gap  values  reported  in  this  section 
are  percentage  figures. 


Table  5,2:  The  gap  values  (percentages)  for  the  36  problems  considered, 

achieved  by  using  f(d(X^,:T)). 


(m,n) 

1 

2 

3 

problem  number: 
4 5 6 

7 

8 

9 

avg. 

(20,2) 

9.5 

9.4 

9.6 

36.7 

32.2 

44.6 

31.5 

18.0 

29.1 

24.51 

(20,3) 

9.0 

7.2 

7.3 

29.8 

39.4 

36.1 

23.6 

38.6 

43.8 

26.09 

(30,2) 

11.8 

25.3 

25.3 

19.7 

21.4 

9.1 

16.0 

19.6 

29.9 

19.79 

(30,3) 

10.0 

17.9 

18.3 

9.5 

15.1 

14.7 

28.3 

20.6 

18.0 

16.93 

Table  5.3:  The  gap  values  (percentages)  for  the  36  problems  considered, 

achieved  by  using  f(d(X^,:G)). 


problem  number: 


(m,  n) 

1 

2 

3 

4 

5 

6 

7 

8 

9 

avg. 

(20,2) 

.0 

.2 

.2 

4.7 

2.2 

14.8 

7.7 

.0 

7.7 

4.17 

(20,3) 

.0 

.0 

.0 

11.8 

3.4 

16.6 

2.3 

5.3 

10.3 

5.52 

(30,2) 

.0 

.0 

.6 

.4 

.5 

.0 

.0 

4.6 

2.3 

0.94 

(30,3) 

1.1 

3.1 

3.1 

.7 

2.8 

4.1 

7.6 

7.3 

1.7 

3.50 

The  global  average  gap  value  for  the  36  problems  we  considered  is 
21.83  in  Table  5.2,  but  is  3.53  in  Table  5.3.  From  now  on,  we  refer  to 
the  gap  values  achieved  using  f(D(Xrj,:G))  in  our  discussion.  Fifteen  out 
of  36  problems  attempted  result  in  gap  values  of  less  than  1;  only  four 
problems  have  gap  values  of  more  than  10.  These  results  are  quite 
encouraging;  for  most  of  the  problems  attempted,  the  restriction  problems 


generate  "good"  feasible  solutions.  We  solved  the  restriction  problem  on 
only  10  different  spanning  trees  of  G,  out  of  a possible  0(m!)  spanning 
trees.  It  would  seem  there  are  "many"  spanning  trees  of  G that  yield 
good  solutions,  and  many  good  solutions  to  the  problem  we  experimented 
with. 

On  some  problems  the  network  structure  seems  to  affect  the  gap 
values  considerably.  For  example,  problems  1 through  3 for  sizes  (20,2) 
and  (20,3)  are  all  solved  on  the  network  G^  with  different  weights;  they 
all  yield  very  low  gap  values  (0  to  .2).  On  the  other  hand,  although 
problems  4 through  6 for  sizes  (20,2)  and  (20,3)  are  solved  on  the 
network  G2,  the  gap  values  they  produce  are  quite  different  from  one 
another;  the  range  is  2 to  17. 

We  now  give  examples  of  the  solutions  generated  by  the  spanning 
•trees.  For  this  purpose  we  use  problem  number  6 of  the  set  (20,2). 
Problem  6 produced  a high  gap  value  (14.7)  with  the  initial  ten  spanning 
trees.  Although  it  is  a small  problem,  we  believe  it  is  a good  example 
problem  to  demonstrate  some  interesting  properties  that  are  common  to 
most  of  the  solutions  generated  in  this  part.  In  the  next  three  figures 
showing  solutions  of  the  bounding  problems  on  network  G2,  we  leave  out 
the  distances  between  the  vertices  of  the  network  to  keep  the  figures 
from  being  too  crowded. 

In  Figure  5.7  we  show  all  of  the  locations  for  the  two  new 
facilities,  suggested  by  the  10  different  spanning  trees  used  by  (SST), 
(LST)  and  (RST).  Please  note  that  a wide  variety  of  locations  are 
suggested;  there  is  no  concentration  of  locations.  This  is  true  for  most 
of  the  problems  we  experimented  with. 
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Figure  5.7:  The  new  facility  locations  suggested  by  the  10  spanning  tree 

problems,  for  problem  6 of  the  set  (20,2).  (The  locations  for  new 
facilities  1 and  2 are  shown  with  squares  and  triangles 
respectively. ) 
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In  Figures  5.8  and  5.9  we  show  the  two  spanning  trees  that 
produced  the  two  best  feasible  solutions  suggested  by  the  set  of  ten 
different  spanning  trees.  The  upper  bounds  generated  by  these  two 
spanning  trees  are  within  .23%  of  one  another,  although  the  locations  are 
drastically  different.  We  made  similar  observations  on  other  problems  as 
well. 

As  pointed  out  in  the  previous  section,  the  shortest  spanning  tree 
is  a prime  candidate  for  producing  a good  bound.  We  kept  track  of  the 
upper  bounds  generated  by  the  different  spanning  trees  selected  for  each 
problem.  Recall  that  for  each  problem  attempted,  we  solve  10  restriction 
problems,  on  the  shortest  spanning  tree  (SST),  on  the  longest  spanning 
tree  (LST)  and  on  8 randomly  generated  spanning  trees  (RST).  For  the  36 
problems  used  in  this  part  of  the  experiment,  some  randomly  generated 
spanning  tree  results  in  the  best  upper  bound  in  26  problems.  For  13  of 
the  36  problems,  the  longest  spanning  tree  generates  a tighter  upper 
bound  than  the  shortest  spanning  tree.  (As  one  would  expect,  f(D(X^,:T) 
values  are  lower  for  (SST)  than  for  (LST)  for  all  problems.)  These  two 
statistics  seem  to  indicate  that  (SST)  has  not  "lived  up  to  the  promise", 
however  the  following  statistics  provide  a counter-argument.  We  compared 
the  bound  generated  by  the  shortest  spanning  tree  to  the  bounds  generated 
by  the  each  of  the  eight  random  spanning  trees,  on  all  problems.  The 
bounds  generated  by  the  shortest  spanning  trees  are  as  good  as  or  better 
than  the  bounds  generated  by  some  random  spanning  tree  69%  of  the  time. 
Furthermore,  the  upper  bounds  generated  by  (SST)  are  on  the  average  only 
6.7%  higher  than  the  best  upper  bounds  generated;  in  27  out  of  36 
problems,  the  (SST)  generated  upper  bound  is  within  10%  of  the  best 


bound . 


Figure  5.8:  The  (random)  spanning  tree  that  produces  the  best  feasible 

solution  (with  a gap  value  of  14.1)  among  the  10  spanning  trees 
used  for  problem  6 of  the  set  (20,2).  (The  locations  for  new 
facilities  1 and  2 are  shown  with  a square  and  a triangle 
respectively. ) 
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Figure  5.9:  The  (random)  spanning  tree  that  produces  the  second  best 

feasible  solution  (with  a gap  value  of  15)  among  the  10  spanning 
trees  used  for  problem  6 of  the  set  (20,2).  (The  locations  for  new 
facilities  1 and  2 are  shown  with  a square  and  a triangle 
respectively . ) 
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In  Table  5.4  we  give  some  statistics  of  the  gap  values  produced  by 
(SST),  (LST)  and  (RST),  evaluated  on  both,  T and  G,  for  all  36  problems 
solved. 


Table  5,4:  The  sample  means  (and  the  sample  standard  deviations)  of  the 

gap  values  produced  by  the  different  restriction  techniques,  SST, 
LST  and  RST.  The  sample  sizes  for  SST  and  LST  are  36  each,  and 
for  RST,  288. 


SST 

LST 

RST 


f(D(XT:T)) 

25.9  (15.4) 
98.6  (35.7) 

61.9  (33.9) 


f(D(XT:G)) 

10.5  (11.8) 
19.4  (13.7) 
15.9  (14.9) 


Based  on  the  statistics  in  Table  5.4  we  perform  several  statistical 
tests.  We  first  test  whether  the  upper  bounds  generated  by  the  shortest 
spanning  trees  are  significantly  better  than  the  upper  bounds  generated 
by  the  longest  and  the  random  spanning  trees.  Since  for  each  problem 
considered  we  solve  8 restriction  problems  on  random  spanning  trees,  we 
have  a sample  of  288  gap  values  for  (RST).  The  sample  size  for  (SST)  and 
(LST)  is  36.  We  assume  that  the  gap  values  in  each  sample  are  normally 
distributed.  In  order  to  perform  a hypothesis  test  on  the  means  we  first 
need  to  establish  whether  the  standard  deviations  in  the  three  samples  we 
have  are  equal  or  not.  We  use  the  Bartlett  test  as  described  in  Section 
15.6  of  the  text  by  Neter  and  Wasserman  (1974).  This  test  allows 


gap 


different  sample  sizes.  Denoting  the  standard  deviations  for  the 
values  resulting  from  (RST),  (SST)  and  (LST)  by  , a ^ and  a ^ 

respectively,  we  set  up  the  test  as  follows: 

r 2 2 2 

C1  - ai  “ °2  ~ a3  ’ 

2 

C 2 : not  all  cr  are  equal. 

The  test  statistic  to  be  used  is: 

B = (2.302585/C)  [ (n^  - r)  log^MSE  - ^ (n^  - 1)  log^gS  ],  where 


c = 1 + ( l/3(r  - 1))  [ Zj=1>r  (nj  - l)'1  - (nT  - r)-1  ], 

-1  2 

MSE  = (n,p  - r)  £ j=l  r ^nj  _ ^sj  as»  anc*  nT  ys  ^60,  ni’  n2’  n3  are 

2 

288,  36  and  36  respectively,  r is  3 and  s^.  's  are  the  sample  standard 
deviations  for  the  three  sets  we  have  (RST,  SST,  LST) . 

We  conclude  if  B <_ "x_^(l-c,r-l) , C2  otherwise.  At  95% 
confidence  level,  the  critical  value  from  the  Chi-square  tables  is  5.99. 
With  our  data,  we  get  MSE  = 210.53,  C = 1.01  and  B = 3.19,  hence  we 
conclude  that  the  gap  values  for  all  spanning  trees  are  distributed  with 
the  same  standard  deviation. 

We  can  now  use  the  following  test  for  the  equality  of  the  means  of 
the  gap  values  from  (RST)  and  (SST)  (Section  1.7,  Neter  and  Wasserman 
(1974)). 

Cl:  ySST  = yRST 
C2:  ySST  ^ yRST 

We  conclude  ^ if  <_  (Y  - Z)  < where 

Aj  = -t(l-  a/2,ni+n2-2)  s(Y  - Z),  A2  = t(l-  s(Y  - Z), 

Y and  Z are  the  average  gap  values  for  (RST)  and  (SST)  respectively,  n^ 
is  288,  n2  is  36  and  s(Y  - Z)  is  an  estimator  of  the  standard  deviation 
of  (Y  - Z).  Using  our  data  we  get  s(Y  - Z)  = 2.59.  For  a = .02,  A^  and 
A2  are  -4.25  and  4.25.  Since  (Y  - Z)  = 5.33,  we  conclude  that  the  means 
of  the  gap  values  from  the  shortest  spanning  trees  and  the  random 
spanning  trees  are  different.  This  is  further  evidence  that  the  shortest 
spanning  trees  are  "special".  We  note  that  when  we  perform  the  same  test 
to  test  the  equality  of  the  means  for  (LST)  and  (RST),  we  conclude  C^, 
namely  that  the  means  are  equal. 

We  also  perform  a test  (same  reference  as  above)  for  the  means  of 
gap  values  produced  by  (SST)  and  (LST).  We  test: 
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C1  : yLST  - ^SST* 

C2  : yLST  > ySST' 

We  conclude  , since  the  difference  between  the  sample  means  of  the  gap 
values  by  (LST)  and  (SST)  is  8.89  and  the  critical  value  for  this  test 
turns  out  to  be  7.18  at  99%  confidence  level. 

We  note  that  the  average  gap  value  for  the  eight  spanning  trees 
used  per  problem  is  less  than  the  gap  value  of  the  shortest  spanning  tree 
problem  in  only  10  of  the  36  problems.  All  of  this  statistical  evidence 
suggests  that  the  shortest  spanning  tree  in  fact  is  a good  candidate  to 
provide  a "tight"  upper  bound. 

It  seems  that  if  we  are  to  use  a single  spanning  tree,  then  the 
shortest  spanning  tree  is  a reasonable  selection.  However,  if  we  use 
several  random  spanning  trees,  then  some  may  yield  better  upper  bounds. 
This  computational  result  is  also  supported  by  intuition. 

The  experiment  suggests  that  to  get  a good  bound  several 
restriction  problems  should  be  solved.  Since  the  restriction  problems 
are  solved  using  SLP,  the  computational  requirements  are  minor,  compared 
to  the  relaxation  problem,  which  is  solved  using  a shortest  path 
algorithm  (within  the  column  generation  scheme) . The  "warm  start" 
technique  described  in  the  previous  section  is  expected  to  speed  up  the 
solution  of  the  individual  restriction  problems  (and  the  relaxation 
problem).  Furthermore,  the  solution  of  a restriction  problem  can  be 
terminated  before  reaching  optimality,  if  the  current  objective  function 
value  exceeds  the  best  upper  bound  found  so  far,  since  in  simplex,  the 
objective  function  values  are  nondecreasing  (recall  we  are  solving  the 
dual,  which  is  a maximization  problem).  Based  on  our  experiment  and 
these  techniques  that  can  be  used  to  facilitate  the  consecutive  solution 


of  restriction  problems,  we  conclude  that  solving  several  upper  bounding 
problems  is  "worth  the  effort". 

To  summarize,  in  the  first  part,  we  experimented  with  36  problems 
using  shortest,  longest  and  random  spanning  trees.  The  best  upper  bounds 
generated  by  these  spanning  tree  problems  are  on  the  average  3.5%  higher 
than  the  lower  bounds.  Although  the  shortest  spanning  trees  generate 
better  bounds  than  any  one  random  spanning  tree  most  of  the  time,  over 
70%  of  the  best  upper  bounds  are  generated  by  the  set  of  random  spanning 
trees. 

In  the  second  part  of  the  experiment  we  attempt  to  study  the 
effect  of  the  network  density  on  the  bounding  procedures.  We  use  four 
different  networks,  which  are  shown  on  Figures  5.10  through  5.13.  All 
networks  have  the  same  set  of  (40)  vertices;  however  the  number  of  arcs 
in  each  network  is  different.  Network  1 is  a "dense"  network,  with  73 
arcs.  Network  2 is  constructed  by  deleting  10  arcs  from  network  1 and 
contains  63  arcs.  Network  3 is  constructed  by  deleting  9 arcs  from 
Network  2,  consisting  of  54  arcs.  Finally,  Network  4 is  arrived  at  by 
discarding  8 arcs  from  Network  3.  Thus,  network  4 is  a "treelike" 
network  with  only  46  arcs  (7  more  than  a spanning  tree). 

On  these  networks  we  consider  three  separate  3-facility  minisum 
problems  with  distance  constraints  between  the  new  facilities.  We  expect 
the  bounds  to  become  tighter  as  the  network  becomes  more  "treelike".  We 


now  report  our  results. 
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Figure  5.10;  Network  1 (with  73  arcs)  used  in  part  2 of  the  experiment. 
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F igure  5.11;  Network  2 (with  63  arcs)  used  in  part  2 of  the  experiment. 
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Figure  5.12:  Network  3 (with  54  arcs)  used  in  part  2 of  the  experiment. 
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Figure  5.13:  Network  4 (with  46  arcs)  used  in  part  2 of  the  experiment. 
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Table  5.5:  The  lower  and  upper  bounds  for  the  three  problems  solved  on 

networks  with  different  sparsity. 


Problem 

73 

Number 

63 

of  arcs 
54 

46 

1 

5775,6092 

6287,6587 

6678,7086 

7023,7171 

2 

8166,8678 

8690,9172 

9084,9293 

9399,9399 

3 

7117,8338 

7525,8636 

7700,7939 

9013,9275 

Table  5.6:  The  gap  values  for  the  three  problems  solved  on  networks 

with  different  sparsity  (number  of  arcs). 

Number  of  arcs 


Problem 

73 

63 

54 

46 

1 

5.5 

4.8 

6.1 

2.1 

2 

6.3 

5.5 

2.3 

.0 

3 

17.2 

14.8 

3.1 

2.9 

average 

9.7 

8.4 

3.8 

1.7 

We  observe  in  Table  5.5  that  the  bounds  increase  with  the 
sparsity,  as  one  would  expect.  The  lower  bounds  increase  more  than  the 
upper  bounds  do,  to  close  the  "gap"  as  indicated  by  Table  5.6.  With  the 
exception  of  problem  1 on  the  network  3,  the  gap  values  consistently 
decrease  with  increasing  sparsity.  The  best  gap  values  are  achieved  on 
the  most  "treelike"  network,  as  expected.  The  shortest  spanning  trees 
provided  the  best  upper  bound  in  3 of  the  12  different  problems 
considered  (3  problems,  each  on  four  different  networks).  A (SST) 
generated  bound  is  tighter  than  some  (RST)  generated  bound  74%  of  the 
time  and  the  (SST)  generated  bounds  are  on  the  average  7.5%  higher  than 
the  best  bounds. 

In  part  two  of  our  experiment  we  also  solve  the  related 
unconstrained  1-median  problems  using  the  same  data  as  in  the  three 
problems  we  report  above.  Our  purpose  for  solving  1-median  problems, 
which  can  be  solved  by  enumerating  all  vertex  locations  and  choosing  the 


best,  is  solely  to  obtain  an  idea  of  the  "goodness"  of  the  bounds.  We 
use  the  data  of  the  3-facility  problems  as  the  data  for  three  independent 
1-median  problems.  Each  problem  we  consider  in  this  part  is  solved  on 
four  different  networks,  hence  we  solve  a total  of  36  1-median  problems. 
Comparing  the  upper  and  lower  bounds  with  the  actual  optimal  objective 
function  value  may  give  an  indication  regarding  the  quality  of  the 
bounds. 

In  each  1-median  problem  considered,  at  least  one  of  the  spanning 
trees  used  yields  as  optimal  the  same  location  as  the  optimal  1-median  of 
the  general  network.  On  the  average,  one-third  of  the  spanning  trees 
used  locate  the  restricted  median  at  the  same  location  as  the  optimal  1- 
median;  for  some  problems  all  ten  spanning  trees  used  succeed  in 
discovering  the  optimal  1-median  of  the  general  network.  In  21  out  of  36 
problems,  the  shortest  spanning  trees  yield  the  same  solution  as  the 
complete  enumeration  does. 

The  average  gap  value  for  the  36  1-median  problems  considered  is  ■ 
.78,  the  maximum  and  the  minimum  gap  values  are  2.8  and  0.0.  In  20  out 
of  36  problems  the  lower  bound  computed  by  the  relaxation  problem  is 
achieved  by  some  restriction  problem  and  hence  optimality  is  established. 
However  the  remaining  16  problems  produce  lower  bounds  that  are  not 
attainable,  since  we  can  verify  through  enumeration  that  the  best  upper 
bound  for  each  of  the  36  problems  is  in  fact  equal  to  the  optimal 
objective  function  value.  The  average  gap  value  for  these  16  problems  is 
1.75.  This  experiment  demonstrates  that  regardless  of  the  simplicity  of 
the  problem  considered,  the  computed  lower  bounds  may  not  be  attainable. 
These  statistics  for  the  1-median  problems  indicate  that  that  there  may 
be  room  for  improvement  in  the  lower  bounds  we  compute.  Another 
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important  message  is  that  the  best  feasible  solutions  found  using  the 
restriction  problems  may  in  fact  be  closer  to  the  actual  optimum  than  the 
gap  values  indicate. 

In  the  final  part  of  our  experiment  we  use  two  actual  networks. 

Figure  5.14  shows  the  road  network  between  the  municipalities  in  the 
provinces  Saskatchewan  and  Manitoba  with  a population  of  over  5,000  and 
Figure  5.15  shows  the  railroad  network  connecting  cities  of  Western 
Canada,  with  populations  of  20,000  or  more.  For  the  road  network  we 
selected  the  provinces  Saskatcewan  and  Manitoba  since  most  of  the  road 
network  and  all  of  the  municipalities  with  populations  of  over  5,000  in 
these  provinces  can  be  represented  as  a network  of  a reasonable  size. 
Regarding  the  selection  of  our  railroad  network,  the  railroad  network  in 
Canada  consists  of  two  main  "blocks",  one  block  in  the  East  and  one  in 
the  West.  There  are  only  two  railroad  connections  between  these  blocks, 
through  Winnipeg.  Thus,  a countrywide  distribution  problem  may  be 
partitioned  into  two  problems,  with  our  Western  Canada  railroad  network 
representing  roughly  one  half  of  the  Canadian  railroad  network. 

We  now  describe  how  these  networks  are  constructed  and  motivate 
the  problems  solved  on  these  networks.  For  both  networks,  we  use 
population  data  as  weights.  The  source  for  the  population  data  is  the 
1985  estimates  from  Canadian  Markets  1985  published  by  The  Financial 
Post,  Canada's  Business  and  Investment  Newsweekly.  Most  of  the  data  in 
this  source  is  referenced  to  the  Bureau  of  Measurement  and  Statistics 
Canada.  We  round  the  population  estimates  to  the  nearest  thousand. 

Using  the  population  data,  we  identify  the  urban  settlements  with 
a population  of  5,000  and  over,  for  our  first  network.  These  population 
centers  are  included  in  our  network  as  existing  facilities.  Below  we 
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list  the  population  centers,  their  populations  (in  thousands)  and  the 
corresponding  vertex  index  in  the  network. 


Vertex  City  Population 


(1000) 

1 

Lloydminster , Sas. 

20 

2 

N.  Battleford,  Sas. 

20 

3 

Swift  Current,  Sas. 

17 

4 

Saskatoon,  Sas. 

173 

5 

Prince  Albert,  Sas. 

41 

6 

Melfort,  Sas. 

7 

7 

Moose  Jaw,  Sas. 

37 

8 

Regina,  Sas. 

176 

9 

Weyburn,  Sas. 

10 

10 

Estevan,  Sas. 

9 

11 

Melville,  Sas. 

5 

12 

Yorkton,  Sas. 

16 

13 

Flin  Flon,  Man. 

10 

14 

Thompson,  Man. 

12 

15 

The  Pas,  Man. 

7 

16 

Dauphin,  Man. 

9 

17 

Brandon,  Man. 

37 

18 

La  Prarie,  Man. 

12 

19 

Winnipeg,  Man. 

590 

20 

Selkirk,  Man. 

10 

21 

Steinbach,  Man. 

7 

We  then  construct  the  arcs  of  the  network  using  a road  map 
published  by  the  Geographical  Services  Directorate  Survey  and  Mapping 
Branch,  Energy,  Mines  and  Resources  Canada,  in  1983.  We  include  primary 
and  secondary  highways,  and  divided  and  undivided  paved  roads  between  the 
existing  facilities.  Some  secondary  paved  roads  and  unpaved  roads  are 
left  out.  During  this  process  we  add  several  dummy  vertices  to  our 
network  corresponding  to  road  intersections.  To  identify  the  distances 
between  the  vertices  of  our  network  we  use  a travel  map  published  jointly 
by  the  Canadian  and  American  Automobile  Associations  in  1986.  The  final 
network  has  37  vertices,  21  of  which  correspond  to  population  centers, 
and  57  arcs.  This  network  is  similar  in  size  to  the  networks  we  used  in 
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Figure  5.14:  Saskatchewan-Manitoba  road  network  connecting  municipalities  with  a population  of  over  5,000. 


the  first  two  parts  of  our  experiment;  it  contains  most  of  the  population 
center  and  road  network  information  for  two  provinces  of  Canada. 

We  consider  two  2-facility  minisum  problems  on  this  road  network. 

In  both  problems,  the  new  facility  1 is  assumed  to  serve  the  centers  in 
Saskatchewan,  the  new  facility  2 is  assumed  to  serve  the  centers  in 
Manitoba.  Considering  the  fact  that  the  closest  population  centers 
between  these  provinces  are  about  200  kilometers  apart,  this  assumption 
seems  to  be  valid.  In  the  first  problem  we  introduce  an  upper  bound  of 
400  kilometers  on  the  distance  between  the  new  facilities.  This  makes 
the  problem  worthwhile  to  study  (the  separate  1-median  problems  have 
almost  trivial  solutions  due  to  the  concentration  of  the  population  in  a 
few  large  cities)  and  it  provides  some  provision  for  one  facility  to 
serve  the  existing  facilities  assigned  to  the  other  facility,  in  case  one 
of  the  new  facilities  is  disabled.  The  additional  travel  in  this  case  is 
limited  to  400  kilometers,  due  to  the  upper  bound.  For  the  second 
problem,  we  remove  the  upper  bound  and  introduce  an  interaction  factor 
for  the  two  new  facilities,  which  may  reflect  possible  shipments  between 
the  two  facilities.  We  use  a weight  of  200,  which  forces  each  new 
facility  to  consider  the  other  one  as  if  the  other  one  was  a "customer" 
with  a population  of  200,000.  The  effects  of  the  distance  constraint  and 
the  interaction  between  the  new  facilities  on  the  solution  to  the  two 
problems  are  similar,  bringing  the  two  separate  optimal  1-medians 
possibly  "closer"  to  one  another.  Nevertheless,  it  is  interesting  to 
observe  the  gap  values  of  the  two  problems. 

The  second  actual  network  we  use  is  a railroad  network  of  Western 
Canada,  including  the  provinces  British  Columbia,  Alberta,  Saskatchewan 


and  Manitoba.  In  this  network,  cities  with  a population  of  20,000  or 
more  are  selected  as  the  existing  facilities. 


Vertex  City  Population 


1 

Prince  Rupert,  B.C. 

(1000) 

20 

2 

Prince  George,  B.C. 

74 

3 

Fort  St.  John,  B.C. 

20 

4 

Vernon,  B.C. 

47 

5 

Courtenay,  B.C. 

41 

6 

Powell  River,  B.C. 

20 

7 

Port  Alberni,  B.C. 

33 

8 

Nanaimo , B.C. 

66 

9 

Victoria,  B.C. 

246 

10 

Vancouver,  B.C. 

1356 

11 

Mission,  B.C. 

25 

12 

Chilliwack,  B.C. 

45 

13 

Kamloops,  B.C. 

70 

14 

Penticton,  B.C. 

25 

15 

Kelowna,  B.C. 

89 

16 

Grande  Prairie,  Alta. 

31 

17 

Fort  McMurray,  Alta. 

49 

18 

Edmonton,  Alta. 

751 

19 

Red  Deer,  Alta. 

60 

20 

Calgary,  Alta. 

712 

21 

Lethbridge,  Alta. 

60 

22 

Medicine  Hat,  Alta. 

57 

23 

Lloydminster , Sas. 

20 

24 

N.  Battleford,  Sas. 

20 

25 

Swift  Current,  Sas. 

17 

26 

Saskatoon,  Sas. 

173 

27 

Prince  Albert,  Sas. 

41 

28 

Moose  Jaw,  Sas. 

37 

29 

Regina,  Sas. 

176 

30 

Brandon,  Man. 

37 

31 

Winnipeg,  Man. 

590 

The  railroad  network  is  constructed  using  the  Railway  Transport 
Network  from  the  fifth  edition  of  the  National  Atlas  of  Canada,  produced 
by  Geographical  Services  Directorate  Survey  and  Mapping  Branch,  Energy, 
Mines  and  Resources  Canada,  in  1984.  Our  network  includes  only  the 
primary  connections  between  the  existing  facilities.  In  case  of  parallel 
connections  owned  by  different  companies,  we  include  only  one  of  the 
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Figure  5.15:  Western  Canada  railroad  network  connecting  cities  with  a population  of  over  20,000- 


connections.  The  distances  on  the  network  are  approximated  using  the 
scale  of  the  map  and  the  distance  data  for  similar  highway  connections. 

Our  network  contains  40  vertices,  31  corresponding  to  population 
centers,  and  48  arcs.  This  network  is  of  similar  in  size  to  the  ones 
used  for  the  first  two  parts,  yet  it  contains  the  primary  rairoad 
connections  in  all  of  Western  Canada.  The  total  population  represented 
in  this  network  is  slightly  over  5 Million. 

We  solve  two  2-facility  minisum  problems  on  this  network.  The  new 
facility  1 serves  the  cities  in  British  Columbia  and  the  new  facility  2 
serves  the  prairie  provinces.  There  are  two  reasons  for  this  choice. 

The  cities  in  British  Columbia  make  up  about  half  of  the  population 
represented  on  the  network.  Furthermore,  the  Rocky  Mountains  form  a 
natural  boundary  between  B.C.  and  the  praries.  We  use  an  upper  bound  of 
800  kilometers  on  the  distance  between  the  two  new  facilities.  In  the 
second  problem,  we  introduce  an  interaction  factor  that  is  equivalent  to 
a city  of  1 million  between  the  two  new  facility  locations. 

We  display  the  spanning  trees  that  resulted  in  the  lowest  upper 
bound  for  each  distance  constrained  problem  and  the  locations  of  the  new 
facilities  on  these  networks.  Figures  5. 16  and  5.17  show  the  spanning 
trees  that  yield  the  lowest  upper  bounds  for  the  problem  on  the  road 
network  and  the  railroad  network  respectively. 

In  both  of  the  problems  on  the  road  network,  the  new  facility  2 is 
located  at  Winnipeg.  This  is  not  surprising,  since  over  85%  of  the 
population  in  Manitoba  is  concentrated  in  Winnipeg;  furthermore,  the 
population  of  Winnipeg  is  larger  than  the  combined  population  of 
Saskatchewan.  In  the  first  problem,  the  distance  constraint  is  active 
and  the  first  new  facility  is  located  near  Yorkton,  Saskatchewan.  Note 
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that  the  shortest  path  from  new  facility  1 to  each  municipality  in 
Saskatchewan  goes  through  Yorkton.  The  new  facility  1 is  located 
"between  Saskatchewan  and  Manitoba".  In  the  second  problem,  the  new 
facility  1 is  located  at  Regina,  the  most  populous  city  of  Saskatchewan. 

The  interaction  factor  of  200,000  apparently  does  not  provide  enough 
incentive  for  the  two  new  facilities  to  "move"  closer  to  one  another. 

(Regina  and  Saskatoon  have  a combined  population  of  over  340,000.) 

In  the  first  problem  on  the  railroad  network,  the  new  facility 
serving  the  prairies  is  located  in  Calgary,  Alberta,  and  the  new  facility 
serving  B.C.  is  located  in  Chilliwack,  B.C.,  80  kilometers  east  of 
Vancouver.  A possible  explanation  of  why  the  new  facility  1 is  not 
loacted  in  Vancouver  can  be  based  on  a population  comparison.  The 
distance  between  Vancouver  and  Calgary  is  over  800  kilometers,  the  upper 
bound.  Although  Vancouver  is  by  far  the  most  populated  city  on  the 
network,  the  new  facility  serving  B.C.  is  not  located  in  Vancouver,  since 
the  combined  population  of  B.C.  is  lower  than  the  combined  population  of 
the  prairies.  In  the  second  problem,  the  new  facility  serving  the 
prairies  is  again  located  at  Calgary  and  the  new  facility  serving  B.C.  is 
located  in  Vancouver,  since  there  is  no  distance  constraint  in  this 
problem.  In  the  following  table,  we  provide  the  gap  values  for  the  four 
problems  solved. 


Table  5.7:  The  gap  values  for  the  four  problems  solved  on  two  actual 

networks . 

Problem 

Network  1 2 Avg. 


Sask.-  Manitoba 
Western  Canada 


4.8  4.1 

.6  .1 


4.45 

.35 
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Figure  5.16:  The  random  spanning  tree,  producing  the  best  solution  (gap  value  of  .6)  for  problem  1 on  the 
railroad  network.  (New  facilities  1 and  2 are  shown  with  a square  and  a triangle  respectively.) 


The  gap  values  for  all  problems  are  very  low,  as  experienced  in 
the  other  parts  of  the  experiment.  Although  none  of  the  gap  values  is 
exactly  equal  to  0.0,  a close  study  of  the  networks  convinces  one  that 
the  solutions  corresponding  to  the  upper  bounds  are  very  likely  to  be  the 
optimal  solutions. 

The  railroad  network  is  very  sparse,  a possible  explanation  for 
the  difference  between  the  bounds  being  less  than  1%  for  both  of  the 
problems  considered.  In  fact,  the  best  upper  bound  for  problem  2 on  the 
railroad  network  is  achieved  by  four  different  spanning  trees,  including 
the  shortest  spanning  tree. 

In  part  3 of  the  experiment  we  also  solve  a 1-median  problem  on 
each  of  the  two  actual  networks.  The  gap  values  turn  out  to  be  0.0  and 
0.2  for  the  Saskatchewan-Manitoba  network  and  the  Western  Canada  network 
respectively.  For  the  road  network,  three  different  random  spanning 
trees  yield  the  best  upper  bound,  for  the  railroad  network,  a total  of  6 
different  spanning  trees  (including  the  shortest)  result  in  the  best 
upper  bound.  The  restriction  problems  providing  the  best  upper  bound 
find  the  optimal  location  for  the  single  facility  in  both  problems 
(Winnipeg  and  Calgary).  The  two  1-median  problems  we  consider  not  only 
result  in  small  gap  values,  but  also  are  solved  optimally. 

To  summarize,  we  experimented  with  a total  of  50  multifacility  (2 
and  3 new  facilities)  minisum  problems  with  distance  constraints  on 
networks  of  varying  sizes  (20  to  40  vertices)  and  sparsities.  The 
average  difference  between  the  best  upper  bound  found  using  the  shortest, 
the  longest  and  eight  random  spanning  trees  per  problem,  and  the  lower 
bound  is  4.07%  for  the  50  problems  considered.  A shortest  spanning  tree 
provides  a tighter  upper  bound  than  some  random  spanning  tree  about  70% 


of  the  time;  the  upper  bounds  provided  by  the  shortest  spanning  trees  are 
on  the  average  7%  higher  than  the  best  upper  bounds  computed.  Using 
several  random  spanning  trees  usually  proves  to  be  effective.  The 
sparsity  of  the  underlying  network  seems  to  effect  the  tightness  of  the 
bounds.  Sparser  networks  in  our  experiment  result  in  lower  percentage 
differences  between  the  bounds.  The  percentage  difference  between  the 
bounds  for  the  1-median  problems  we  solved  is  .78%.  Every  1-median 
problem  we  attempted  was  solved  optimally  by  some  spanning  tree;  hence 
the  differences  between  the  bounds  are  due  to  the  lower  bounds.  The  two 
actual  networks  we  used,  provided  bounds  very  similar  to  the  bounds  we 
computed  using  the  networks  in  the  first  two  parts  of  the  experiment. 

Our  experiment  is  encouraging  and  provides  some  empirical  evidence 
that  near-optimal  solutions  to  location  problems  on  general  networks  can 
be  found  with  a reasonable  amount  of  effort. 

5.6  Additional  Upper-Bounding  Techniques 

We  now  discuss  four  additional  techniques  for  computing  an  upper 
bound  for  (PG).  The  first  of  these  techniques  constructs  a feasible 
solution  starting  from  the  solution  of  (PLB) , the  other  three  construct  a 
"special"  spanning  tree  either  using  the  solution  of  (PLB)  or  using  the 
data  of  the  problem.  These  techniques  are  simple  heuristics  based  on 
intuition,  and  they  may  improve  the  upper  bound  computed  by  using 
previously  described  techniques,  such  as  the  solution  of  (PUB)  on  a 
shortest  spanning  tree.  We  apply  the  four  techniques  described  in  the 
next  few  paragraphs  to  some  of  the  problems  in  our  experiment,  mainly  for 
demonstration  purposes. 


Using  the  solution  of  the  relaxation,  we  may  be  able  to  construct 
a feasible  solution  to  G and  hence  possibly  improve  the  upper  bound. 

Some  basic  columns  in  the  optimal  solution  of  (PLB)  correspond  to  tight 
paths  in  network  BC.  Each  tight  path  corresponds  to  a unique  set  of 
locations  for  the  new  facilities  on  the  tight  path,  along  some  path 
between  two  existing  facilities  in  the  original  network.  We  use  the  term 
"imbedding"  when  referring  to  locating  the  new  facilities  on  a tight  path 
in  the  original  network.  Since  (PLB)  is  a relaxation  of  (PG),  we  may  be 
required  to  imbed  the  same  new  facility  at  more  than  one  location, 
possibly  resulting  in  an  infeasible  solution.  We  can  select  a unique 
location  for  each  new  facility  from  among  the  several  locations  suggested 
by  the  solution  of  the  relaxation  problem  and  achieve  a feasible  solution 
provided  that  the  selected  locations  satisfy  the  distance  constraints. 

If  more  than  one  set  of  locations  is  feasible,  we  can  evaluate' several 
feasible  solutions  and  select  the  one  with  the  lowest  objective  function 
value.  We  denote  this  heuristic  technique  by  HFS  and  demonstrate  it  on 
one  problem.  Other  (more  refined)  heuristics  can  be  developed  to 
construct  a feasible  solution  (or  several  feasible  solutions)  using  the 
solution  of  (PLB). 

We  can  also  use  the  imbedding  of  the  tight  paths  on  G to  help  us 
construct  a spanning  tree  using  the  following  "value"  system.  The 
"value"  of  an  arc  is  equal  to  the  number  of  new  facilities  located  on  the 
arc.  We  can  then  construct  a "maximal  value"  spanning  tree  using  the 
"values"  of  the  arcs  in  Kruskal's  algorithm  and  selecting  the  shortest 
arc  in  case  of  ties.  We  denote  this  technique  by  VST. 

Another  idea  for  generating  a spanning  tree  is  based  on  shortest 
path  spanning  trees.  For  each  vertex  of  the  network  we  can  construct  a 
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shortest  path  spanning  tree  rooted  at  the  vertex.  Subsequently  we  can 
carry  out  a "popularity  poll"  among  the  arcs  of  the  network  by  counting 
the  number  of  times  each  arc  is  selected  during  this  process.  An  arc 
that  is  included  in  k shortest  path  spanning  trees  gets  a popularity  mark 
of  k.  We  can  construct  a "most  popular"  spanning  tree  by  using  the 
popularity  marks  of  the  arcs  in  Kruskal's  algorithm.  In  case  of  ties, 
the  arc  with  the  shortest  length  can  be  selected.  We  denote  this 
technique  by  PST. 

The  final  technique  we  suggest  in  this  section  uses  a single 
shortest  path  spanning  tree.  We  root  the  tree  at  the  "collapsed" 
facility  location.  The  collapsed  facility  location  is  the  location  of 
the  new  facilities  if  all  of  the  upper  bounds  on  the  distances  between 
the  new  facilities  are  equal  to  zero.  For  example,  for  the  n-facility 
minisum  problem  we  can  find  the  collapsed  facility  location  by  solving  a 
1-facility  problem,  where  the  weight  of  a vertex  is  equal  to  the  sum  of 
the  n weights  (one  weight  per  new  facility)  at  that  vertex.  We  have  used 
this  notion  earlier  in  Chapters  2 and  3.  We  denote  this  method  by  CST. 

Extensive  additional  experimentation  must  be  done  to  evaluate  and 
compare  the  four  upper-bounding  techniques  we  suggest  in  this  section. 

We  apply  PST  and  CST  to  one  problem  from  each  problem  set  in  part  1 of 
the  experiment  we  report  in  Section  5.5.  We  also  use  one  problem  to 
illustrate  some  of  the  properties  of  the  solutions  and  to  demonstrate  the 
upper  bounding  techniques  that  involve  imbedding  of  tight  paths  from  the 
optimal  basis  of  the  relaxation  problem,  namely  HFS  and  VST. 

From  part  1 of  the  experiment  in  the  previous  section,  we  use  the 
problem  for  each  problem  size  which  resulted  in  the  highest  gap  value. 
These  are  problems  numbered  6,  6,  8 and  7 for  sizes  (20,2),  (20,3), 
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(30,2)  and  (30,3)  respectively.  We  use  procedures  (CST)  and  (PST)  to 
generate  additional  upper  bounds  for  these  four  problems.  Procedure 
(CST)  uses  the  spanning  tree  rooted  at  the  collapsed  facility  and 
procedure  (PST)  uses  the  "most  popular"  spanning  tree.  We  compare  the 
bounds  provided  by  (CST)  and  (PST)  with  the  bounds  generated  by  each  of 
the  10  spanning  trees  used  earlier.  The  table  below  shows  the  number  of 
spanning  trees  (out  of  the  initial  ten)  for  each  problem  that  produced 
higher  (looser)  upper  bounds  than  (CST)  and  (PST). 

Table  5.8;  The  number  of  spanning  trees  (out  of  a total  of  ten,  the 
shortest,  the  longest  and  eight  random)  that  yield  higher  upper 
bounds  than  (CST)  and  (PST). 


Procedure  (PST)  does  not  provide  very  good  bounds  on  these  four 
problems;  it  does  not  improve  any  of  the  best  upper  bounds  found  using 
the  initial  ten  spanning  trees.  Procedure  (CST)  results  in  a better 
upper  bound  than  82.5%  of  the  spanning  trees  used  initially.  In  two  out 
of  the  four  problems,  the  "collapsed  spanning  tree"  improves  the  best 
upper  bound  found  so  far.  The  gap  values  for  problem  number  6 of  the  set 
(20,2)  and  for  problem  number  7 of  the  set  (30,3)  are  reduced  from  14.7 
to  7.1  and  from  7.6  to  7.2  respectively.  Although  our  experience  with 
these  two  techniques  is  very  limited,  it  seems  that  (CST)  has  some 
potential  for  generating  good  bounds.  It  is  not  complicated  to  implement 
(CST);  the  collapsed  facility  can  be  found  using  an  enumeration  of  the 
vertices  (assuming  vertex  optimality  property)  and  the  spanning  tree 


Size  prb.no.  CST  PST 


(20,2)  6 

(20,3)  6 

(30.2)  8 

(30.3)  7 


10 

8 

5 

10 


3 

9 

0 

1 
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rooted  at  the  collapsed  facility  can  be  generated  using  a shortest  path 
algorithm. 

We  now  give  examples  of  the  solutions  generated  by  the  spanning 
trees  and  the  imbeddings  suggested  by  the  relaxation  problem.  For  this 
purpose  we  use  problem  number  6 of  the  set  (20,2)  from  the  first  part  of 
the  experiment  in  the  previous  section. 

In  Figure  5.18  we  show  the  spanning  tree  rooted  at  the  collapsed 
facility  and  the  solution  suggested  by  (CST),  which  provides  a better 
upper  bound  than  all  of  the  10  spanning  trees  used  by  (SST),  (LST),  and 
(RST).  The  collapsed  facility  for  this  problem  is  at  vertex  15;  the 
unconstrained  optimal  locations  for  the  new  facilities  one  and  two  are  at 
vertices  3 and  14  respectively.  The  solution  of  the  problem  on  this 
spanning  tree  yields  locations  that  are  again  drastically  different  from 
the  spanning  trees  on  Figures  5.8  and  5.9. 

It  is  interesting  to  note  that  the  spanning  trees  generated  by 
(CST)  and  (PST)  for  this  problem  differ  by  only  a single  arc,  yet  (CST) 
yields  a gap  value  of  7.1  (the  best  so  far  for  this  problem)  while  (PST) 
yields  a gap. value  of  25.6.  This  suggests  that  the  objective  function 
value  of  the  restriction  problem  may  change  drastically  when  one  attempts 
to  generate  a spanning  tree  by  changing  a single  arc  of  some  other 
spanning  tree. 

We  also  show  (in  Figure  5.19)  the  different  new  facility  locations 
that  are  implied  by  the  optimal  solution  of  the  lower  bounding  problem. 

We  find  these  locations  by  imbedding  the  tight  paths  in  the  optimal  basis 
of  the  relaxation  problem  on  G.  This  imbedding  suggests  some  heuristic 
feasible  solutions.  We  evaluate  these  solutions  (technique  (HFS))  and 


Figure  5.18:  The  spanning  tree  rooted  at  the  collapsed  facility  (vertex 

15)  for  problem  6 of  the  set  (20,2),  and  the  solution  (with  a gap 
value  of  7.1)  on  this  spanning  tree.  (The  locations  for  new 
facilities  1 and  2 are  shown  with  a square  and  a triangle 
respectively . ) 


also  solve  a restriction  problem  implied  by  the  imbeddings,  on  the  "most 
valuable"  spanning  tree,  (VST), 

As  Figure  5.19  shows,  the  new  facilities  one  and  two  are  imbedded 
at  five  and  three  different  locations  respectively.  The  locations  for 
new  facility  one  are  indicated  by  letters  A,  B,  C,  D and  E;  the  locations 
for  new  facility  two  are  marked  with  X,  Y and  Z.  Note  the  only  feasible 
pairs  of  location  are  (C,X),  (D,Y),  (E,Z)  and  (E,Y),  where  the  first 
letter  indicates  the  location  of  new  facility  one.  These  pairs  can  be 
considered  as  heuristic  solutions  suggested  by  the  lower  bounding 
problem.  We  evaluated  these  four  solutions;  they  result  in  gap  values  of 
17.4,  10.1,  13.4  and  25.3  respectively.  Note  that  although  neither  of 
these  solutions  result  in  a better  upper  bound  than  the  one  suggested  by 
(CST) , two  of  them  produce  gap  values  (10.1  and  13.4)  that  are  lower  than 
the  lowest  gap  value  (14.8)  produced  by  the  techniques  (SST),  (LST)  and 
(RST).  Furthermore,  three  of  them  produce  lower  gap  values  than  the 
average  gap  value  (22.1)  produced  for  this  problem  by  the  8 random 
spanning  trees. 

If  the  problem  studied  has  more  than  two  new  facilities  then  it 
will  not  be  easy  to  find  feasible  solutions  using  the  imbeddings  as  we 
did  in  Figure  5.19.  There  may  not  even  be  a distinct  set  of  locations 
that  satisfy  the  distance  constraints.  However,  the  procedure  (VST) 
still  can  be  used.  In  problem  6 of  the  set  (20,2),  the  "most  valuable" 
spanning  tree  includes  all  of  the  arcs  on  which  the  relaxation  problem 
imbeds  some  new  facility.  These  arcs  constitute  the  "core"  of  the 
spanning  tree  or,  one  "bucket"  in  Minieka's  description  of  the  spanning 
tree  algorithm.  However  they  do  not  span  the  entire  network;  the  rest  of 
the  spanning  tree  is  constructed  using  the  shortest  spanning  tree 


Figure  5.19:  The  imbeddings  of  new  facility  1 (locations  A,  B,  C,  D,  E) 
and  new  facility  2 (locations  X,  Y,  Z)  suggested  by  the  optimal 
basis  of  the  relaxation  problem  for  problem  6 of  set  (20,2).  The 
numbers  in  parantheses  indicate  the  number  of  times  a new  facility 
is  imbedded  at  that  location.  Only  pairs  (C,X),  (D,Y),  (E,Z)  and 
(E,Y)  are  feasible. 


203 

algorithm.  The  optimal  locations  on  the  "most  valuable"  spanning  tree 
for  new  facilities  1 and  2 are  at  vertex  one  and  between  vertices  3 and 
8,  one  unit  away  from  vertex  3.  We  do  not  show  the  "most  valuable" 
spanning  tree,  since  the  optimal  objective  function  value  for  this  tree 
turns  out  to  be  42%  higher  than  the  lower  bound,  worse  than  all  of  the 
spanning  trees  considered  so  far.  For  this  specific  problem,  the  "most 
valuable"  spanning  tree  did  not  prove  "valuable"  at  all.  More  problems 
must  be  attempted  before  any  conclusions  can  be  reached  regarding  its 
potential. 

Our  computations  in  this  section  indicate  that  the  upper  bounds 
found  using  (SST),  (RST)  and  (LST)  can  be  improved  in  some  cases  using 
additional  spanning  trees  and  the  solution  of  the  relaxation  problem.  In 
particular,  procedure  (CST)  seems  to  be  promising;  it  produced  tighter 
upper  bounds  than  over  80%  of  the  random  spanning  trees  in  the  four 
problems  tested. 

Further  research  directed  towards  more  refined  upper  bounding 
(spanning  tree  selection)  techniques  and  a possible  incorporation  of  the 
bounds  into  a heuristic  branch-and-bound  scheme  may  further  close  the  gap 
between  the  upper  and  lower  bounds  of  the  problems  considered. 


CHAPTER  6 
SUMMARY 


In  this  dissertation  we  have  focused  on  several  network  location 
problems,  all  of  which  involved  upper  bounds  on  distances  between 
selected  pairs  of  facilities.  The  problems  of  Chapters  2 through  4 were 
for  tree  networks,  while  those  of  Chapter  5 were  for  planar  networks. 

In  Chapter  2 we  studied  the  two-facility  problem.  In  general,  many 
two-dimensional  problems  are  interesting  since  the  one-dimensional 
version  of  a problem  may  be  easy  to  solve,  while  the  two-dimensional 
version  may  suggest  a generalization  of  the  solution  procedure  to  solve  . 
the  n-dimensional  version.  Some  two-facility  problems  are  interesting  in 
their  own  right.  Although  more  complex  than  the  one-facility  problems, 
there  is  a lot  of  structure  in  the  two-facility  problems  that  we  can 
exploit  to  suggest  efficient  solution  techniques. 

We  focused  on  a two-facility  problem  with  a general,  convex 
objective  function  containing  distances  between  existing  and  new 
facilities  and  a distance  constraint  involving  the  two  new  facilities. 
Later  we  have  shown  that  some  of  the  procedures  we  suggest  can  be 
generalized  to  the  case  where  the  objective  function  contains  the 
distance  between  the  new  facilities  as  well. 

By  solving  two  separate  single-facility  problems  we  reduce  the 
original  problem  to  a problem  on  a path  of  the  tree  network.  This  path 
problem  is  equivalent  to  a one-dimensional  problem  with  rectilinear 
distances.  For  the  unrestricted  version  of  the  problem,  provided  that 
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the  distance  constraint  is  active,  we  convert  the  problem  to  a single- 
facility problem  on  a line  segment,  which  is  an  easy  problem  in  many 
instances.  For  the  restricted  version  we  develop  a procedure  to 
enumerate  a subset  of  the  location  vectors  to  find  the  optimum. 

We  considered  two  specific  objective  functions,  minisum  and 
minimax,  and  discussed  how  existing  solution  procedures  can  be  combined 
with  the  procedures  we  developed  to  yield  efficient  algorithms  for  the 
problem  with  the  distance  constraint. 

In  Chapter  3 we  considered  the  multifacility  minimax  problem.  This 
problem  can  be  expressed  as  an  optimization  problem  with  a single 
variable,  z,  the  objective  function  value.  Using  "separation  conditions" 
we  developed  several  solution  techniques.  We  have  shown  that  this 
problem  can  be  expressed  as  a problem  of  finding  the  root  of  a piecewise 
linear,  concave  function  for  every  pair  of  the  existing  facilities.  The 
maximum  of  the  roots  yields  the  optimal  objective  function  value.  We 
employed  a line  search  technique  that  checks  the  feasibility  of  some 
objective  function  value  z at  every  iteration,  and  updates  the  value  of  z 
depending  on  the  outcome  of  the  feasibility  test.  We  also  implemented  a 
procedure  to  find  the  roots  of  the  piecewise  linear  functions  explicitly, 
with  successive  linear  extrapolations.  Using  the  version  of  the  path 
conditions  that  only  considers  direct  paths,  we  developed  an  algorithm 
which  is  quadratic  in  (n*m).  The  final  solution  procedure  we  suggested 
in  this  chapter  is  an  extension  of  the  sequential  location  procedure. 

Our  procedure  either  constructs  a feasible  solution  for  a given  value  of 
z or  identifies  an  increase  in  the  value  of  z to  reach  feasibility,  and 
is  repeated  until  feasibility  is  achieved.  This  procedure  performed  the 
best  in  our  computational  experiment.  It  was  an  order  of  magnitude 
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faster  than  the  other  techniques  we  suggested.  It  was  quite  robust,  in 
that  it  was  not  sensitive  to  the  sparsity  of  the  weight  matrix  and 
different  upper  bound  values  on  the  distance  constraints.  Problems  with 
90  existing  and  10  new  facilities  were  solved  on  the  average  in  3.3 
applications  of  the  sequential  location  procedure  and  in  3.3  VAX-seconds. 
We  also  noted  that  all  of  the  procedures  we  suggested  could  be 
generalized  to  handle  distances  between  pairs  of  new  facilities  in  the 
objective  function,  and  constraints  involving  existing  and  new 
facilities . 

We  considered  a more  general  problem  in  Chapter  4.  The  model  we 
developed  in  this  chapter  is  valid  for  a large  group  of  objective 
functions  and  allows  upper  bounds  on  functions  of  selected  distances.  We 
assume  that  the  objective  function  of  the  problem  is  nondecreasing  in  the 
distances.  This  general  model  reduces  to  well-known  problems  for  special 
objective  functions  in  the  absence  of  constraints.  Using  a monotonicity 
result  and  substitution  of  variables  we  have  shown  that  our  problem  is 
equivalent  to  an  optimization  problem,  which  we  subsequently  converted  to 
a linear  programming  problem  by  way  of  the  separation  conditions.  Since 
the  linear  programming  problem  may  have  many  rows,  we  considered  the  dual 
and  outlined  a revised  simplex  scheme  with  column  generation  to  solve  the 
dual  linear  program.  The  evaluation  of  the  reduced  costs  for  most  of  the 
columns  of  the  dual  problem  is  equivalent  to  checking  the  separation 
conditions.  We  considered  several  implementations  of  shortest  path 
algorithms,  each  corresponding  to  a different  column  pricing  policy.  We 
also  devised  an  extension  of  the  sequential  location  procedure  which 
identifies  an  entering  column  if  the  current  solution  is  not  optimal. 
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We  performed  a computational  experiment  to  test  the  relative 
efficiency  of  the  different  column  pricing  techniques.  In  the  experiment 
we  used  the  minisum  problem  and  randomly  generated  problem  data.  We 
found  that  pricing  out  a subset  of  the  columns  is  more  efficient  than 
entering  the  first  column  with  a negative  reduced  cost.  Performing 
complete  column  pricing  by  finding  all  shortest  paths  in  the  auxiliary 
network  did  decrease  the  number  of  iterations  but  did  not  result  in  a 
decrease  in  computational  times.  The  procedures  that  limit  the  entering 
paths  to  direct  paths  in  the  auxiliary  network  proved  to  be  more 
efficient  than  their  counterparts  entering  direct  and  indirect  paths. 

The  procedure  which  is  an  extension  of  the  sequential  location 
procedure  turned  out  to  be  the  most  efficient  one,  concerning  both  the 
CPU  times  and  the  number  of  iterations.  Although  only  a small  number  of 
nonbasic  columns  are  explicitly  priced  out  in  this  procedure,  the  number 
of  iterations  to  solve  a problem  was  comparable  to  the  number  of 
iterations  performed  by  the  procedures  using  complete  column  pricing. 

The  computational  times  were  an  order  of  magnitude  lower  than  the  times 
for  all  of  the  other  procedures.  Reasonably  large  problems  with  50 
existing  and  5 new  facilities  were  solved  on  the  average  in  1,200  pivots 
and  in  12  seconds  on  an  Amdahl-470.  We  found  that  the  relation  between 
the  number  of  iterations  and  the  basis  size  is  nonlinear;  however  the  low 
value  of  the  exponent  (1.4)  is  quite  encouraging.  The  basis  inverse 
matrices  in  the  larger  problems  of  our  experiment  were  consistently  over 
99%  sparse. 

The  model  developed  in  Chapter  4 is  important  since  it  has  many 
tree  network  location  problems  as  its  special  cases,  including  some 
problems  not  considered  in  the  literature.  The  solution  technique  is 


sufficiently  general  that  it  can  be  used  with  many  different  objective 
functions  and  constraint  sets. 

In  Chapter  5,  we  applied  the  tools  developed  in  Chapter  4 to  some 
location  problems  on  general  networks.  Many  multifacility  location 
problems  on  general  networks  are  known  to  be  NP-hard.  We  suggested 
solving  a relaxation  problem  and  several  restriction  problems  to  develop 
upper  and  lower  bounds  on  the  optimal  objective  function  value.  We 
stated  a sufficient  condition  under  which  a restriction  problem  will 
yield  the  same  optimal  objective  function  value  as  the  problem  on  the 
general  network.  Using  some  examples,  we  attempted  to  clarify  the 
relations  between  the  restriction  problems  and  the  original  problem.  We 
described  several  different  restriction  problems;  most  are  obtained  by 
constructing  some  spanning  tree  of  the  general  network  and  solving  the 
problem  on  the  spanning  tree  using  the  methodology  of  Chapter  4.  We 
experimented  with  the  bounding  techniques  we  suggested,  using  a minisum 
problem  with  distance  constraints  involving  pairs  of  new  facilities.  The 
average  percentage  difference  between  the  upper  and  the  lower  bounds  was 
4%.  We  also  found  that  the  shortest  spanning  tree  is  a prime  candidate 
to  provide  a "good"  feasible  solution.  In  our  experiment,  sparser 
networks  resulted  in  tighter  bounds.  For  the  1-median  problems  we 
considered,  the  average  difference  between  the  bounds  was  .8%,  although 
for  each  problem  some  restriction  problem  was  able  to  identify  the 
optimal  1-median  on  the  general  network.  We  also  considered  two  actual 
networks  in  Canada,  and  the  problems  we  solved  on  these  networks  resulted 
in  similar  percentage  differences  between  the  bounds. 

The  general  solution  technique  we  devised  in  Chapter  4 may 
encourage  others  study  some  constrained  network  location  problems  and 


discover  solution  procedures  that  exploit  the  specific  structure  of  the 
problem  under  consideration,  resulting  in  improvements  to  our  all-purpose  . 
solution  technique  for  special  problems. 

The  material  in  Chapter  5 establishes  how  bounds  can  be  evaluated 
for  many  location  problems  on  general  networks.  The  problems  we  consider 
are  continuous  in  nature,  and  we  know  of  no  other  way  to  compute  bounds 
for  such  problems.  Efforts  in  the  direction  of  incorporating  these 
bounds  into  some  exact  or  heuristic  solution  procedure  may  prove 


fruitful. 


APPENDIX  A 

THE  ORDER  OF  THE  NUMBER  OF  DIRECT  AND 
SIMPLE  PATHS  IN  THE  NETWORK  BC 


We  first  derive  the  order  of  the  number  of  direct  paths.  A direct 

path  starts  at  some  E-node,  say  E^,  goes  through  a set  of  N-nodes  and 

ends  at  a second  E-node,  say  E^.  There  are 

C0  = m(m-l)/2 
m2  v 

pairs  of  E-nodes  in  the  network  BC.  The  number  of  direct  paths  between  a 
given  pair  of  E-nodes  passing  through  exactly  j N-nodes  is  given  by 


j ! C . ; 
n j’ 

there  are  ^C^.  ways  of  selecting  j elements  out  of  a set  with  n elements 
and  j!  ways  of  ordering  these  j elements.  Using  ^P ^ = jl^C^.,.  the  total 
number  of  direct  paths  between  a given  pair  of  E-nodes  is  then 


P.  + P„  + P„  + . . . + P . 
nln2n3  nn 

Subsequently,  the  total  (exact)  number  of  direct  paths  in  the  network  BC 


is 


C„  P-. 

m 2 ^j=l,n  n j 

2 

Note  that  C„  is  0(m  ) and  P.  (=  n!/(n-j)!)  is  0(n!).  We  conclude  that 
m2  n j J 

the  number  of  direct  paths  is 

0(m^n ! ) . 

We  note  the  above  argument  establishes  an  exact  number  on  the 

number  of  direct  paths.  The  order  can  be  arrived  at  using  a simple 

2 

argument:  There  are  0(m  ) pairs  of  E-nodes  and  there  are  0(n!)  paths 

through  a complete  network  (N-nodes)  for  every  given  pair  of  E-nodes. 
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We  now  motivate  the  order  of  the  number  of  simple  paths  in  the 
network  BC.  Consider  a special  path  of  the  form: 

E-N-E-N  - - N-E. 

We  call  such  a path  an  "alternating  path";  note  the  path  regularly 
alternates  between  the  E-nodes  and  the  N-nodes.  Assuming  n < m,  the 
maximum  number  of  nodes  on  an  alternating  path  is  2n+l ; we  call  such  a 
path  a "maximal  alternating  path".  All  of  the  N-nodes  are  present  on  a 
maximal  alternating  path.  We  denote  the  set  of  all  maximal  alternating 
paths  by  MAP,  and  establish  the  number  of  all  such  paths.  A MAP-path  can 
start  at  any  E-node  (out  of  m possible),  proceed  to  any  N-node  (out  of  n 
possible),  then  to  any  E-node  except  the  one  already  on  the  path  (m-1 
possible  choices),  then  to  any  N-node  except  the  one  already  on  the  path 
(n-1  possible  choices)  and  so  on.  Hence  the  total  number  of  paths  in 
MAP,  N^p,  is  [ m!  / (m  - n)!  ] n! 

= m * n * (m-1)  * (n-1)  * * 2 * (m-n-1)  * 1 * (m-n).  (1) 

Note  there  are  2n+l  factors  in  the  above  product,  a factor  for  each  node 
on  the  path.  Now  a MAP-path  uses  every  N-node,  and  n+1  E-nodes.  More 
than  n+1  E-nodes  would  give  a non-simple  path,  so  the  MAP-path  uses  the 
maximum  number  of  E-nodes.  Any  simple  path  which  is  not  a MAP-path  uses 
less  N-nodes  and/or  E-nodes,  so  the  order  of  the  number  of  MAP-paths  is 
the  dominating  order. 

At  this  point,  we  give  an  example.  The  smallest  problems  we  use 
in  the  experiment  in  Chapter  4 have  20  existing  and  3 new  facilities. 

For  such  a problem,  the  number  of  direct  paths  is  2850  whereas  the  number 
of  maximal  alternating  paths  is  697,680. 

We  now  derive  an  upper  bound  on  NMip.  Note  the  product  can  be 


rewritten  as 
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{ T r (m-k)  : k = 0,  . . . , n } * { TT  (n-k)  : k = 0 n-1  } (2) 

By  definition 

{ TT  (n-k)  : k = 0,  n-1  } = n!. 

The  first  bracket  in  (2)  can  be  written  as 

m (m-1)  (m-2)  (m-n)  = m! /(m-n-1) ! . (3) 

This  term  is  bounded  above  by  m11"^  and  by  m!.  Note  for  n = 1,  expression 
(3)  becomes  m (m-1)  (which  is  clearly  0(mn+'*'),  and  for  n = m-1,  the 
expression  (3)  becomes  m!.  In  Chapter  4,  we  use  0(n!mn+^)  as  the  order 
of  the  number  of  simple  paths  since  for  most  of  our  test  problems  m is  an 
order  of  magnitude  large  than  n.  We  note  however  that  both  0(n!m!)  and 
0(n!mn+'*')  are  valid  upper  bounds  on  the  order  of  the  number  of  simple 
paths  in  the  network  BC. 


APPENDIX  B 
ACCESS  TO  THE  CODES 


The  Fortran  codes,  with  listings,  we  used  in  Chapters  3,  4,  and  5 
are  available  on  a PC-compatible  floppy  on  file  with  a copy  of  the 
dissertation  with  the  Department  of  Industrial  and  Systems  Engineering  of 
the  University  of  Florida. 

The  codes  used  in  Chapter  3 are  written  to  be  compiled  on  a VAX 
11/750,  the  codes  used  in  Chapters  4 and  5 are  written  to  be  compiled  on 
an  AMDAHL-470.  The  floppy  disk  contains  a file,  READ. ME,  which  lists  the 
codes  stored  on  the  disk  with  a brief  description  of  the  codes. 

The'  purpose  of  each  program  is  summarized  at  the  top  of  each  code. 
The  primary  variables  are  defined  for  each  code.  The  codes  are  indented 
and  comments  are  spread  throughout  the  programs  to  help  follow  the  logic. 
These  codes  are  experimental,  and  not  prepared  for  general  use.  Although 
we  made  efforts  to  shorten  the  run  times,  the  codes  employ  no  special 
programming  techniques,  with  the  exception  of  the  few  discussed  in  the 
corresponding  chapter. 
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APPENDIX  C 

RANDOM  NUMBER  GENERATORS 


1 . The  RAN  Function  (VAX-11  FORTRAN) 

The  RAN  function  is  a general  random  number  generator  of  the 
multiplicative  congruential  type.  The  result  is  a floating-  point  number 
that  is  uniformly  distributed  in  the  range  between  0.0  inclusive  and  1.0 
exclusive.  The  call  to  the  RAN  has  the  form: 

y = RAN(i) , 

where  y is  set  equal  to  the  value  associated,  by  the  function,  with  the 
argument  i . The  argument  i must  be  an  INTEGER*4  variable  or  INTEGER*4 
array  element.  The  argument  should  initially  be  set  to  a large,  odd 
integer  value.  The  RAN  function  stores  a value  in  the  argument  that  it 
later  uses  to  calculate  the  next  random  number. 

RAN  uses  the  following  algorithm  to  update  the  seed  passed  as  the 
parameter : 

SEED  = 69069  * SEED  + 1 (MOD  2**32). 

The  value  of  SEED  is  a 32-bit  number  whose  high-order  24  bits  are 
converted  to  floating  point  and  returned  as  the  result. 
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2.  The  GGUBFS  Function  (AMDAHL-470  FORTRAN) 


IMSL  Routine  Name 

GGUBFS . 

Purpose 

Basic  Uniform  (0,1)  random  number  generator. 

Usage 

FUNCTION  GGUBFS ( DSEED ) . 

Arguments  GGUBFS- 

Resultant  Deviate. 

DSEED- 

Input/Output  double  precision  variable  assigned  an 
integer  value  in  the  exclusive  range  (1,2147483647) 
DSEED  is  replaced  by  a new  value  to  be  used  in  a 
subsequent  call. 

Algorithm 

(The  deviate  R is  generated  by:) 
SQ  = DSEED 

S = 75  SQ  (mod  231  - 1) 

-31 

R = 2 J S ' 
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